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WEIGHTED SHIFTS AND COVARIANCE ALGEBRAS(') 
BY 
DONAL P. O’DONOVAN 


ABSTRACT. The C*-algebras generated by bilateral and unilateral 
shifts are studied in terms of certain covariance algebras. This enables 


one to obtain an answer to the question of when such shifts are G.C.R., 
or not, or even when they are N.G.C.R.. In addition these shifts are clas 
sified to within algebraic equivalence. 


Introduction. This paper is concerned with certain types of bounded 
linear operators on separable Hilbert spaces. The types are the weighted 
shifts, both bilateral and unilateral. These operators have been studied quite 
extensively and have been found to contain examples of many different types 
of operator behaviour [4], [15], (17). Among other results, necessary and suffi- 
cient conditions are given here for when such shifts are G.C.R. or type I 
($3.4), for when the C*-algebra that they generate contains the compact op- 
erators ($2.5, $3.2), and for when two shifts are algebraically equivalent 
($2.4, $3.3). In order to answer these questions, it is necessary to obtain a 
useful description of the C*-algebras they generate and of their irreducible 
representations. For this purpose covariance algebras are most appropriate 
[3], [9], (10), [23], (24). 

In the first part of this paper the results on covariance algebras that are 
needed are presented. Many of these results are known; they appear chiefly 
in [24]. In the case of the group Z, some of the proofs are conceptually eas- 
ier and it seemed worthwhile to present them. The principal new result here 
is Theorem 1.2.1, in which it is shown that a necessary and sufficient condi- 
tion on a homeomorphism ¢ of a compact space X in order that every ideal 
in the covariance algebra Cw. @) contain an element of C(X), is that the 


periodic points be a “‘small’’ set. The theorem is in fact proven for a general 


c*(ul, Z). 


The C*-algebras generated by weighted shifts with closed range are coms 
pletely characterized in $$2.2 and 3.1 in tems of covariance algebras C*(X, ¢). 


Received by the editors July 3, 1974. 
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It is shown that the space X has a certain canonical form which for a given 
shift makes explicit all of its irreducible representations as weighted shifts. 
Also this canonical form of X classifies shifts to algebraic equivalence ($2.4, 
$3. 3). This last term was introduced by W. B. Arveson [2] to describe two Oop- 
erators T and S for which the map T — S extends to a *-isomorphism of 


C*(T) onto C*(S). For normal operators this means they have the same spec- 


trum, so for weighted shifts we have an ‘‘induced’’ version of this result. 

If the above remarks seem to make little distinction between unilateral 
and bilateral shifts, this is because as is seen in Parts II and III, the differ- 
ences are much less than might have been expected. In fact the type of anal- 
ysis carried out here is almost equally applicable to all classes of centered 
operators [21]. 

The terminology and notation used are the standard ones [2], [8]. Thus, 
for example, L(H) and C(H) denote the bounded linear operators and compact 
linear operators on a Hilbert space H, C*({ }) denotes the C* -algebra gener- 
ated by { } and 1, %’ denotes the commutant of an algebra 2, and H,, denotes 


the Hilbert space on which a representation 7 of some C*-algebra acts. The 


order of presentation is: 


Part I 
$1.1 
$1.2 
$1.3 
$1.4 

Part Il 
§2.1 
§2.2 
§2.3 
§2.4 
$2.5 

Part III 
$3.1 
§3.2 
$3.3 
$3.4 


Covariance Algebras 
Representations 

Ideals 

Type I on G.C.R. algebras 
A representation theorem 
Bilateral Weighted Shifts 
Uniqueness of the basis 
The generated C*-algebra 
Shifts without closed range 
Algebraic equivalence 
N.G.C.R. shifts 
Unilateral Weighted Shifts 
The generated C*-algebra 
N.G.C.R. shifts 

Algebraic equivalence 
G.C.R. shifts 


PART I. COVARIANCE ALGEBRAS 


1.1. Representations. If x is a *-automorphism of a C*-algebra U, the 


semidirect product or covariance algebra C*(%l, Z) is constructed as follows: 
Let (ul, Z) be the set of all %l-valued functions F on Z for which the norm 
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= Il F(@)|| is finite. Z) is a Banach space in this norm 


n=-0° 
and if a multiplication and an involution are defined by 


(F , * F,)(n) = F k)) 


and 

F*(n) = x"(F(-n)"), 
then /'(%, Z) becomes a Banach algebra with approximate identity. Now 
C*(, Z) is defined to be the enveloping C*-algebra [8]. Thus, for F € 
Z) put 

[Fl = sup 


where 7 ranges over all irreducible *-representations of Ql, Z). One can 
show [9], [24] that ||F|| =0 =»F =0 so C*(U, Z) is defined to be the com- 
pletion of al, Z) in this norm. More generally, if G is any locally compact 
group of *-automorphisms of 2, then c*(U, G) can be constructed [9], [23], 
[24]. To every representation p of a covariance algebra C*(, Z) corre- 
sponds a pair (7, U), where 7 is a representation of Yl, and U is a unitary 
operator on H_ with the property that Uz (Ayu! = m™(x(A)) for all A in W, 
In fact if F € /'(Ql, Z), then 


(1.1) p(F)= a(F(n))U". 


n=—00 
We shall express this relationship by writing p = (7, U). 

Let A and A denote the spectrum, or dual, and the quasi-spectrum of 
Wf respectively [8]. A can be naturally embedded in A, and A can be en- 
dowed with the Mackey Borel structure and the Jacobson topology [8], [13]. 

Any representation 7 of 2 has a central decomposition, 7 = Seetx) dylx) 
where jt is a standard Borel measure on A, c(x) is a measurable cross sec- 
tion of the quotient map Fac(2l) — A, and the center of 7(2) consists of the 
diagonalisable operators M. These are the operators M, (where f is in BA), 
the bounded Borel functions on A), defined on F in H, by (M , F)(x) = {(x)- 
F(x) [8]. 

Any *-automorphism y of % induces an obvious map ¢ of A into A 
which leaves A invariant. Further, it is immediate from their definitions that 
¢ is an isomorphism for the Borel structure and a homeomorphism for the to- 
pology. 

For a representation p = (7, U) of C*(l, Z), let 9 denote the inner automorphism 
of n(2l) given by 4 — UAU- | Then the center of ml)’, the commutant of nl), is 
invariant under 9. As is shown in [13], this leads to the fact that 


-1_ 
(1.2) UM,U-! = 


4 DONAL P, O’DONOVAN 


for each M, € M. This implies that p is quasi-invariant with respect to ¢ i.e. 
if” o ez are pairwise absolutely continuous, where (¢ o = u(G(E)). So if 
h = Xp o )/dp is the Radon-Nikodym derivative, then defining Uy on F € H, by 


(Ug FXx) = 


Us is unitary and has the property that UM =M),g+ Thus « 
M,soU=B-:- Us, where B is a decomposable operator. 

If p =(z, U) is an irreducible representation, then it follows immediately 
from 1.2 (since = M), that must be ergodic with respect to y, i.e. if 
ECA is measurable and $(E) = E, then u(E) =0 or 1. Since f(A) = A, p, 
is based on either A or AA. The former is a necessary and sufficient con- 
dition that 7 be a type I representation [8, Proposition 8.4.8]. If so, then 7 
has a unique decomposition 7=7,, ®7, ®7,@..., where 7, is a repre- 
sentation of multiplicity i, 1<i< X,. In fact 7,= SB c(x) du(x), where B, = 
{x: c(x) is quasi-equivalent to some i+v with v irreducible}. Each B, is 
clearly ¢-invariant, so again by ergodicity if 7 is of typeI, then 7 has uni- 
form multiplicity. In fact, one can go further and conclude that p is concen- 
trated on some i ={x: c(x)=i+v and dim H, =n}. 

An ergodic quasi-invariant measure p may have p(0) = | for some orbit 
0 of @. In this case the measure is said to be transitive. Otherwise it is 
called intransitive [20]. 

Suppose p =(z, U) is an irreducible representation of cC*(U, Z) for 
which p, is transitive, here this means purely atomic, based on the orbit of 
a, in @ say. If a, is not in A, then one sees readily that p is not in fact 


irreducible. So a, is in A, and then we have seen that m=i+ [4 du (x), 


and 7 is independent of the particular cross section c(x) chosen [8]. If Pn 
is purely atomic, then any cross section is measurable, and one can be cho- 
sen so that Uym(A)UZ! = G(A) for all A € Then U = where Bé 
(2), Further for such #,, one sees that if m is not multiplicity free, then 
p is reducible. 


To summarize, if p = (7, U) is any irreducible representation of C*(Ul, Z) 
for which p, is transitive, then yp, is based on A,7 isa multiplicity free 
representation, and U =M, - Us, for some h € B(A), with |/| = 1. If the 
point @,, is not periodic, then the family of representations p = (7, M,U4) 
are all possible and all unitarily equivalent. If a, is periodic of period k, 
then again the representations (7, M,U) are all possible and two such are 
unitarily equivalent if and only if 


In general if u, is not transitive, then it appears that the relationship 
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= cannot always be lifted to give =7 0X. How- 


ever for the case of %l commutative this is of course automatic, so one has in 
this case that for every quasi-invariant ergodic measure p on A, C*(2, Z) 
has an irreducible representation on L(A, pt). 

While not much can be said about the intransitive irreducible representa- 
tions, it is at least clear that one of them cannot be unitarily equivalent to a 
transitive representation. For if V: (71, U)—- @,, U,), then V must imple- 
ment a unitary equivalence between 7, and 7, and thence between the cen- 
ters of 7,(%)' and 7,(%)'. This is clearly impossible if p, is atomic and 
Hy is not. 


1.2. Ideals. We now want to consider ideals in c*(u, Z). Since, as was 
remarked earlier, /'(U, Z) C C*(2l, Z), there is a natural injection i of U into 
C*(U, Z), with i(A)(n) = Ab, for A € l. The specific question to be an- 
swered is: If I is an arbitrary nonempty selfadjoint ideal in C*(U, Z), under 
what conditions on %! and the action of Z on it can it be concluded that INW 
# {0} 

If the induced action ¢ on A is free, ice. no periodic points, then it fol- 
lows from [24] that the above is true. We shall show the following. Let H,= 
{x € A: $'(x) = x},i=1, 2,.... 


Theorem 1.2.1. For all nonempty ideals I in C*(U, Z), INU # {0} if and 
only if interior H, =@ all i. 


Recall that the topology is that of Jacobson. An immediate consequence 
is the useful 


Corollary. If some nonperiodic point has a dense orbit in A, then the 
property’ is true. 


Before embarking upon a proof of the theorem, we present a sequence of 
lemmas, at least some of which will be used elsewhere. 

Definition. If ¢ is an ergodic quasi-invariant transformation on the finite 
measure space (X, ), and F is any second countable topology subordinate 
to the Borel structure, by suppgp is meant the minimal closed ¢ invariant 
set whose complement has measure zero. 

Alternatively SUPPg HL is the maximal set on which p is diffuse, i.e. p(A) 


> 0 if A is nonempty and open. With this terminology, it is due to Halmos 
[14, p. 26] that 


Lemma 1.2.1. For almost every point in X, its orbit under } is dense in 
SUPP; 
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The following is also well known. 


Lemma 1.2.2. If is a standard measure on X, and P denotes the set 
of points periodic under q, a quasi-invariant, ergodic Borel transformation, 


then p(P) =0 or else p consists of a finite number of atoms, 


Proof. Since yx is standard and ¢ is quasi-invariant, there exists N 
with »(N) = 0, and X|N a standard Borel space invariant under ¢. But then 
there is a second countable topology subordinate to the Borel structure on 
X|N which is Hausdorff. Then the orbit of any periodic point is closed, and 
the conclusion follows for the previous lemma. 

If F € 1'(U, Z), define E (F) = F(n), n € Z. 


Lemma 1.2.3, is continuous in the C*-norm on Z) and 


Proof. We recall that the C*-norm on /'(2, Z) is ||FI| = sup pllCF)I|, 
where p is an irreducible representation of / 1Ql, Z). If v € A is not peri 


odic under ¢, consider “‘1e transitive irreducible representation p,, = (7, Uy) 
defined in $1. Then H,= @%_H,, with H, =H,, all i, and 


0 n 
=1 
so < Ip 
If v in A is periodic, of period k say, let p§ denote the finite dimen- 
sional representation ps = = (7, M U4). If n =1(mod k) and if H, 
H,, all i, then 


v 


= (= m(F(j)(MgU 4) €,, ‘) 


j=- 


where A= g(v) - and 0; = uy ee. But 
Ale (FC + > FU + 5 for all j. 
Aj=1 
Hence given &, 7, there exists g for which 
\(p&(FE, n)| > F(n))UG 


Taking sups, it has been shown that for all v € A, there exists p,, with 
> Hence, since ||E(x)|| = sup, the result. 
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Corollary ([9], [24]). If F € 1'\(U, Z), then ||F\| = 0 implies F =0. 


Now E is extended by continuity to c*(U, Z). If p is any irreducible 
representation of C*(2l, Z) one can attempt to define E*: p(c*(l, Z)) > 
pl) by E*(p(F)) = p(E_(F)). For this we need 


Lemma 1.2.4, If p =(z7, U) is an irreducible representation for which Ln 
does not consist of a finite number of atoms, then g* is both well defined 


and continuous, for all n € Z, 


Proof. We sketch the argument which is a standard one. With the notation 
of the last section, it follows from Lemma 1.2.2 that 7 = S2e(x) du, where 
is a freely acting Borel isomorphism of the standard Borel space X. Using 
the fact that the Borel structure is both countably generated and countably 
separated, given any integer N and x € X, one can find a Borel neighborhood 
W,, with and disjoint. Thence one easily obtains 
iV. a disjoint, measurable covering of X subordinate to {W,} Given 
€>0, find H € l'Q, Z) and N € Z, with H(n) =0 if |n| >N and ||F-H|| < 


€. Then if € € H_, and Xs denotes the characteristic function of the set S, 


< Lill? 


= 


where (1.3) follows from 


N 
2 
2 n 


N 
2 
>f, c(yXE (H))My (y) Ky) du(y). 


Thus ||7(E,(H))|| < ||p(H)|]. But E, is continuous from the previous lemma, 
and p and 7m are continuous, and all are of norm < 1, so ||7(E,(F))|| < ||p(F)| 
+ 2e. Hence the lemma for n = 0. The general case n =k is obtained by 
considering p(H) - 


The converse to this last lemma is also true, as if p, does consist of a 
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finite number of atoms it is easy to define F € ra, Z), for which p(F) = 0 
but p(E,(F)) #0. 
The following might be considered as a sort of converse to Lemma 1.2.3. 


It is one of the keys to understanding the structure of the covariance algebra 
c*(i, Z). 


Lemma 1.2.5. For F € C*(l, Z), if E,(F) =0 forall n, then F =0. 


Proof. What must be shown is that if p(E_(F))=0 Wn, Vp, then p(F) = 
0 Vp. If p =(a, U) is any irreducible representation, then clearly p, = (7, 
A *U) is also, for any A € C, with |A| = 1. Choose €, 77 in H For any H 
€ ra, Z), we have 
i=-0o 


So we can define b: S'— C, by 


Since b(A) € If H, F in C*(l, Z), then from the defi- 
nition of the norm in C*(2l, Z) we have that 


b,(A) = (p(F)E, n) uniformly in A. 


Hence h,(A) — /(A) in L7(S'), But if b,(A) = and /(A) = 
then a,, /,. However a., = (ME (HE, n), which by Lemma 1.2.3 
converges to zero, each i. Hence /,=0 for all i, so /(A) = (p(F)E, n) = 0. 
In particular (p(F)&, 7) = 0. Since and p are all arbitrary, we conclude 
that F = 0. 


It is an immediate consequence of the last two lemmas that 


Corollary. If p =(z, U) is an irreducible representation of C*(2, Z), 
then p is faithful if and only if p, is not periodic and m is faithful. 


Remark. From here, when we speak of the support of p,, we shall mean 
with respect to the Jacobson topology. That we may do so and that supp p= 
iz): ker A) > ker 7} is shown in [13]. Thus 7 is faithful if and only if 
supp =A. 

We turn now to the proof of the theorem. Let H, = {a € A: $'(a) = a}. 
Let P = (U2 ,H,. Let I be a selfadjoint ideal in C*(l, Z). We want to show 
that if interior H, =@, all i, then INU J {fo}. 

Any ideal | is uniquely determined as the kernel of a certain family of 
irreducible representations {p,},, of c*(l, Z). Let it byes be the cor 


oo co 
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responding measures on A, If supp / = U, es SUPP [Ly # A, then from the defi- 

nition of the topology, for some T #0 in YU, m(T) =0 for all 7 in supp /. 

Thus T € I, 

So assume supp I! = A. Let F 40 be in J. For all nonperiodic 

Py: = 0 implies p,(E (F))=0 for all by Lemma 1.2.4. Let 

N = fy: Pp: is not periodic}, and Y = U,, enSupp + From the above it 

follows that mE (F)) = 0 for all 7 in Y and all nm in Z. Thus if F £0, it 

follows from Lemma 1.2.5 that for some 7) in Y° and integer No» 7 (E (F)) 

# 0.. There are now two cases to be considered. 


Suppose first that 7) is periodic, Using the fact that | is an ideal it 
can be assumed that \|7,(E,(F))|| = 2 say. Since supp! = A, it must be that 
Y° CP, and the hypothesis that the interior of H, is empty for all i implies 
that either 

(i) 7) is the limit of a net {74} ,,p of nonperiodic points, 
or that 

(ii) it is the limit of a sequence of periodic points whose periods tend to 
infinity. 

This makes use of the fact that ¢ is a homeomorphism in the Jacobson 
topology. Since Y° is open and contained in P, if (i) holds then it aep is 
ultimately in P. But each-7 , is not periodic, a net iv} C P can be chosen 
with v, 7, and period v, +>, This is (ii). 

Since Y° CU, eM\NSUPP Hy» if (ii) holds then the net iz} can in fact 
be chosen so that the representations p, = (7), Me Ue) are each in 


em\n for some 

On the other hand, if 7) is not periodic then since 7) € P implies that 
for some collection CP, ker ker 7,, it follows that 7 (E,(F)) #0 
implies 7, (E,(F)) #0, some a , and we are in the first case above. 

Choose A € /'(2, Z) with ||A - Fl| and choose >0 with ||Al|, < 
|E + 4. If p = (a, M,U4) is a transitive irreducible representation 
of C*(Ql, Z), based on the orbit of 7), where 7) has period k, and if A= 
+ +++ then for any 7 € with = = 1, 


(E (ADE, < + (7 (E, (ANE, 


Thus 
So 
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+% if No. 


Thus ultimately 


< + 4 < 2 


since 


lp £A)Il = lle 4) - 1A - Fl = % 


But then by upper continuity [8, Proposition 3.3.2], it follows that |7(E,(A)| < %, 
thence \|7,(E,(F)| < %, a contradiction, This is the desired result since it has been 
shown that if interior H,=@ all i, then supp! = A implies that I = {0}. 

For the converse, suppose interior "th #@, then some 7, has an open 
neighborhood Wan C H, This means that for some A € 2, m(A) =0 for all 7 
in the complement of Wr? but 7,(A) #0. For each a in A, let Pq = (%» Uy) 
denote the transitive irreducible representation based on its orbit. Since 
7 (A)=0 all a ‘mplies A =0, it suffices to find F #0 in QL, Z), with 
p,(F)=0 all ain A, 

If @ has period k and F € /'(U, Z), then certainly p,(F) =0 if 
nk)) = 0, 0 < i, 1< k- 1. Define 


n=—0o 
F(n)=0 if |n| > +1, 
F(n)=v,A_ if \n| < ie 


Then since every point in W_ has period at most jg, it follows that any 
nontrivial solution for the v_.’s to a system of at most j)(j) + 1)/2 equations 
gives an F with the desired properties. 

We may notice that Lemma 1.2.4 implies that every irreducible represen- 
tation of a covariance algebra C*(2, Z) is in fact a covariance algebra; 
C*(n(2l), Z,) if m is periodic and C*(n(%), Z) otherwise. We also have 


Theorem 1.2.2, Let p =(7, U) be any irreducible representation of 
c*(U, Z). If | is any nonzero selfadjoint ideal in p(C*(2, Z)), then 1 An(U) 
# 103. 


Proof. If 7 is periodic, then Z)) n(Ul) @ Mis where M, =kx 
k matrices, and the result is clear. If 7 is not periodic, then p_(P) =0, by 
Lemma 1.2.2, and p, is diffuse on supp y,, so interior H; = @ each i, where 
H; =H, supp p,. Thus the theorem applies. 


1.3. Type I covariance algebras. For a separable C*-algebra 2%, the 


following are equivalent [2], [8]: 
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(i) Every irreducible representation of % contains the compact operators. 

(ii) Any two irreducible representations of %l with the same kernel are 
unitarily equivalent. 

(iii) Every factor representation of & is of type I, i.e. m(U)" is a type 
I von Neumann algebra. 

If any of these hold, 2 is said to be G.C.R. or type I. Takesaki [23] and 
Zeller-Meier [24] have given conditions under which a general covariance al- 
gebra is G.C.R. Utilizing the idea of ‘induced representations’’, it is shown 
that C*(l, Z) is G.C.R. if and only if % is G.C.R. and the action of ¢ on 
A is smooth or regular in the sense of Mackey [20]. Glimm [12] and Effros 
[11] give lists of conditions under which this is true. Since the group here is 
Z this result can be stated more simply than in general. 

Definition. A point a € A is said to be discrete in its orbit (under ¢) if 


n. 
'(a) >a as n, or implies a is periodic (with respect to ¢). 


Theorem 1.3.1. If 2 is G.C.R., then the following are equivalent: 
(i) C*(U, Z) is G.C.R. 

(ii) Every a in A is discrete in its orbit. 

(iii) No two orbits have the same closure. 


(iv) Every quasi-invariant ergodic measure on A is transitive. 


Proof. (i) = (ii) If C*@Ql, Z) is G.C.R., if a € A is not periodic, and if 
p, is the transitive irreducible representation base on the orbit of @, then 
p(C*(l, Z)) > C(H >)» So by Theorem 1.2.2, for some A € Yl, p (A) is a rank 
one projection. In general 7 (A) 7 (A) can never be rank one unless 7 
or 7 (A) is zero. We conclude that p fA) can be rank one only if $’(a)(A) = 
0 forall if igs But if '(a)— this is impossible. Hence (ii). 

(ii) = (iii) If (ii) holds and y, and y, contradict (iii), then ¢ *(y,)— 


m. 
y, Some in} and ‘(y,)— y, some im Then that ¢ '(y,;) + y, some 


i/,1, 1, distinct, is immediate. 

(iii) =» (i) If (iii) holds then no two transitive representations have the 
same kernel unless they are unitarily equivalent. So if (i) does not hold then 
there exists an intransitive measure p. But then it follows from Lemma 1.2.1 
that there must be at least two distinct orbits which have supp p as their 
closure. 

(i) =» (iv) In the course of the last part, it was shown that (i) = (iv). 
But from the description given in $1 of the factor representations of C*(U, Z) 
it follows that if every quasi-invariant ergodic measure is transitive, then 


every factor representation is the direct sum of irreducibles and hence of type 
I. Thus (iv) = (i). 
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1.4. A representation theorem for certain operators with closed range. 

If A € L(H), as usual H separable, then among the many ways of expressing 
the fact that the range of A is closed are the following [7]: 

(i) 3C > 0 such that ||A*Ax|] > Ve € (ker A). 

(ii) The origin is an isolated point of the spectrum of A*A, 

This last shows in particular that if A has closed range, then every 
representation of A does. If A = UD is the polar decomposition [2], with U 
a partial isometry and D a positive operator, then by using (ii) to define a 
contour integral it is shown in [6] and [7] respectively that U*U and U be- 
long to C*(A), We shall also need the following. The proof is entirely straight- 
forward so we omit it. 


Lemma 1.4.1. If m is a representation of a C*-algebra % C L(H), and if 
A € U has polar decomposition A = UD and closed range, then mA) has 
polar decomposition mA) = n(U) + n{D). 


Suppose A = UD has closed range. Let ¢ and ¢7! denote the contin- 
uous linear maps of C*(A) into itself, defined for B in C*(A) by $(B) = 
UBU* and = U*BU. 

Let D = C*({p%(D), C*(A), where the notation is = 
U” if n>0O and u™) ~ (U*)"” if n <0. An alternative description of D is 
that it is the minimal C*-algebra containing D and 1 and invariant under both 
¢ and d~', Let I, denote the closed selfadjoint ideal in C*(A) generated 


by U*U — UU*, and let q denote the canonical quotient map from C*(A) into 
C*(A)/ly. Then 


Theorem 1.4.1. If (C) holds, namely if for every finite collection De 
CD, .,D,U™ € ly implies that each € Iy, then q(C*(A)) is *-iso- 


morphic to a covariance algebra c*(q(D), Z). 


Proof. Since q(C*(A)) is a C*-algebra, we can find a *-isomorphism 7 
of g(C*(A)) into some L(H,,), and it may be assumed that 7 is nondegenerate 
[8]. For brevity, let B' denote the image of any B € C*(A) under the repre- 
sentation 7 og. Then by Lemma 1.4.1, we have that A‘ = U'D" is the polar 
decomposition. Since q(U) is normal, U’ is also, so N(A’) = N(U") = N(U'*) 


= N(A‘*), and the assumption of nondegeneracy implies that U’ is unitary. 

If D'=70 q(D), then D' is the minimal C*-algebra containing 1 and D’, and 
invariant under ¢': B'— U'B'U'* and U'*B'U'. Thus d(C*(A)) 
is *-isomorphic to c*(A"), to and ¢’ and are inverse *-au- 
tomorphisms of p' implemented by the unitary operator U’, Additionally 


WEIGHTED SHIFTS AND COVARIANCE ALGEBRAS 13 


it follows that -,D’U'" =0 implies = 0 in J. The primes 
will now be omitted. 

Let B —_ = *-subalgebra of C*(A) consisting of all elements of 
the form ze , for some finite subset J of Z, and each D Eetenging 
to D, 1). U € B, B is clearly dense in ct (A). Let 
the action of Z on D be given by the automorphism ¢, and define x: B > 
Z) by D _U"\k) = where 5, J is the Kronecker delta. 
This map is well defined since (C’) guarantees the uniqueness of the repre- 
sentation of elements of B. It is clearly linear and into 1D, Z). The veri- 
fications that x is multiplicative, *-preserving, and 1-1 are all routine. De- 
fining x~ 1 on the range of x we see that it is continuous in the i norm, 
so that x7} can be extended to a representation of / 1D, Z). But since this 
representation is faithful on D, the corollary to Lemma 1.2.5 gives the conclusion. 


PART II. BILATERAL WEIGHT SHIFTS 


2.1. Uniqueness of the basis. Let H be a separable Hilbert space. Then 
V in L(H) is a bilateral weighted shift means that for some orthonormal bas 
sis le, ez» Ve, where are complex scalars, It is well known 
that such an operator is reducible if and only if some d;=0 or id.} isa 
periodic sequence, and that two such are unitarily equivalent if |d,| = |d; | 
each i [15], [18]. Thus we restrict ourselves to the case d; >0. 


Theorem 2.1.1, The basis te} with respect to which V has this shift 
form is unique if and only if V is irreducible. 


Proof. First if V is the ordinary unweighted bilateral shift, i.e. multipli- 
cation by z on L*(s}), and if ¢(z) is any inner function then {2"6} ez form 
an alternative basis. If V is period’c of period k one simply has to consider 
iz"b(z*)} ez. The converse can be shown by a direct argument or it can be 
considered a particular case of a more general situation. For this let (X, p, 
¢), and (Y, v, x) be triples of (standard Borel space, finite measure, quasi- 
invariant Borel isomorphism). For g>0 and f>0O in L™(Y, v) and L°(X, p) 
respectively, let M ex and M,Ug denote the obvious weighted translation 
operators on H, = (Y,v) and H,=L 2(x, respectively. 


Lemma 2.1.1, If M,U4 and M Ux are irreducible and are unitarily equiv 
alent via V € L(H,,H,) then there exists a nonsingular Borel isomorphism 
A of (X, p) onto (Y, v) such and V=U). 


The theorem now follows if two distinct bases are considered as L 2(Z, Hy) 
and L*(Z, p,). 
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For the proof of the lemma, let =C and 
“iM, on ez)» Let U, = C*(M eg)» U,= C*(M Since constant 
function 4 = 1 must " cyclic for the irreducible M gs it follows that the 
C*-algebra of functions in D must have all of L 2X, p) as its L? closure. 
Since p is finite and we have a C*-algebra of functions in L™, one can read- 
ily conclude that every function / in L? can be approximated almost everywhere by 
a sequence h, of L™ functions bounded in L™ norm. Then one obtains thatL, — L 
strongly. Thus the von Neumann algebra generated by D, is in fact it of 
L™(X, ). Similarly for D, and L™(Y, v). —_ M,Uy and M,U, are the respective 
polar decompositions, one has vd, , « '=9,, and Fc by the above re- 
marks VL™(X, = L™(Y, v). we have standard measure algebras, 
the results of [16] imply that the isomorphism is implemented by a nonsingu- 
lar point transformation A, The remaining conclusions of the lemma follow 
easily. 


We should like to thank L. G. Brown for discussions related to the above. 


2.2. The generated C*-algebra and the canonical diagonal spectrum. 
Let the bilateral weighted shift V have polar decomposition V = UD, where 
D is the diagonal operator De, =d_e , and U is the bilateral shift. Using 
the terminology of Theorem 1.4.1, I,, = {0}, and ¢"(D) = UDU~", so D = 
C*(ID"(D)} ez) consists of diagonal operators. Let X denote the maximal 
ideal space or spectrum of the commutative C*-algebra 9). Let ¢ also denote 


the induced homeomorphism of X. Then since condition (C) clearly holds, we 
have 


Theorem 2.2.1. If V is a bilateral weighted shift with closed range, 
then C*(V) is *-isomorphic to the covariance algebra C*(X, $). 


If iV, = UD}, ex 18 a collection of bilateral weighted shifts, we may 
assume dian at leastone V,, has positive weights, so that Vy = ey. 
with U the bilateral shift and D diagonal is the polar decomposition. Let 
= for A € L(H) and D = ez y¢,)+ Denoting the 
spectrum of D by X and the induced homeomorphism of X by ¢ also, in a 


manner entirely analogous to the last theorem, one obtains 


Theorem 2.2.2, If V,, has closed range then C yeu) is *+isomor- 
phic to C*(X, $). 


Returning to the case of one shift, a natural question is which pairs 
(X, &) can arise under the correspondence in Theorem 2.2.1. If n € Z, de- 
fine w, in Hom(D, C)=X by w,(A) =a, if A= diagla,},.7. Then ¢/(w_) 
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= and ez is dense in X, since if € C(X), with /(w,) = 0, all 
n, then the inverse Gelfand transform of { is zero, and hence {=0. So the 
pair (X, d) has the property that there exists an orbit of ¢ which is dense 
in X, 


Let Y denote the spectrum of D. Define T: X > II*™ Y, by 
T(x) =(..., <G(D)), (D), (D)), ...). 


If T(X) is given the topology induced by the product topolog, ca ITY, then 
since D is generated as a C*-algebra by i6"(D)}_ ez» T is both continuous 
and 1-1. Consequently since X is compact, it is a homeomorphism of X onto 

T(X). T(X) will be denoted by X_ and referred to as the canonical form of 
the diagonal spectrum X. Note that under T, ¢ becomes the usual right shift 
on a product space. 


Theorem 2.2.3. If & is a homeomorphism of a compact Hausdorff space 
X, then there exists a bilateral weighted shift V, with C*(V) naturally *-iso- 
morphic to C*(X, ) if and only if 

(i) there exists a point x) € X, with dense orbit under p, and 

(ii) there exists { in C(X, R), such that {f o P"\ ez separates points 
in X, 


Proof. The necessity of (i) has been shown. For (ii), let py € C(X_, R) 
be the projection on the zero coordinate and pull back to X. Conversely, 
assume first that x) is not periodic under ¢. If / € C(X, R) satisfies (ii), 
let {‘(x) = /(x)+ 2||/|]. Let be a transitive ergodic measure on the orbit 
of xp, andlet p, =(7,, Uy) be the corresponding representation of C*(X, d). 
By the corollary to Lemma 1.2.5, p is a faithful representation and if V is a 
bilateral weighted shift with weights d_ = {"("(x,)), then V is the image 
under p of an obvious F € C*(X, ¢) and has positive weights and closed 
range, so an application of the Stone-Weierstrass theorem gives the desired 
conclusion. If x) is periodic, X consists of a finite number of points, say 
k, and any shift with nonzero weights of period k will clearly suffice. 


From the proof it is immediate that 


Corollary 1. C*(X, ) is naturally *-isomorphic to a C*-algebra gener- 
ated by a family of bilateral weighted shifts if and only if ¢ has a dense 
orbit. 


We also have, using the real and imaginary parts as in the theorem, 


Corollary 2. If ¢ has a dense orbit, then C*(X, $) is *-isomorphic to a 
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C*-algebra generated by two bilateral weighted shifts if there exists { in 
C(X, C) such that separates points in X. 


This enables us to give an example of a C*-algebra generated by a 
pair of shifts, which is not generated by a single one. 

Example 1. With fz: z&C, |z|=1}. Let X= ns? and ¢ be the 
usual shift. This pair clearly satisfies the conditions of Corollary 2, but if 
for € C(X, R), {fo eg separates points, then letting T: X 
be given by T(x) =(... , ) then T is a homeo- 
morphism onto its range. Now y= T ogo T~! is the usual shift on T(X) C 
II _,/(X), and the set of fixed points of ¢ must be homeomorphic to those of 
Y. But this gives T homeomorphic to /(X) C R, which is impossible. 

Some examples of how the theorem itself applies follow: 

Example 2. Let Y be any compact subset of the real line, and X = I~ _Y 
with the product topology. Let ¢ be the usual shift. Since, with respect to 
the natural product measure, ¢ is measure preserving and ergodic, by the lem- 
ma of Halmos quoted earlier, Lemma 1.2.1, almost every point has dense or- 
bit, and clearly any coordinate function works. 

Example 3. Let X be the n-torus, and let ¢ be an ergodic rotation of 
this topological group. Again from Lemma 1.2.1, this time with respect to 
Haar measure, almost every point has dense orbit. In fact, every point must 
have. Define € C(X, R) by /(z1, ++, z = Re(z, + Z,+...+2,). A 
simple argument using the fact that a Vandermonde matrix is invertible if and 
only if the elements are distinct [17] shows that {f° ¢"} ., separates points. 

Returning to the canonical diagonal spectrum, recall that we had T: X—> 
x. by (2.2). So for the dense subset iw} ez in X, that was defined pre- 
viously, we have T(w,)=(..., (Recall V = UD, with 
D = diagid,}._,.) Thus X_ is simply the closed subset of II™(spectr. D) 
generated by D and its translates. And if x is the usual shift, V is alge- 


braically equivalent to the element Fy, in C*(X_, xX) of the form 


Fy(n)=p, if n=1, 
=0 ifnél. 


Thus at least when V is G.C.R. it is a simple matter using the represen- 
tation theory described earlier to write down the irreducible representations 
of V. 

Example. Let V = UD with 


Then X_ is easily determined and one ascertains that V has, to within uni- 
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tary equivalence, only the following distinct irreducible representations: 
(i) the identity representation, 
(ii) a representation as a shift with weights {..., 1, 1, 1, 2, 2, 2,...4, 
(iii) as a shift with weights {..., 2, 2, 2, 1, 1, 1,...}, and 


(iv) for each A € C, a one dimensional representation as A and 2A, 


2.3. Shifts without closed range. It was necessary that V have closed 
range in Theorem 2.2.1 in order that the diagonal algebra D bea subalgebra 
of C*(V) and so that for all B € p, we should have B + U® in C*(V) for all 
k € Z. In general if V does not have closed range, one can only say that 
C*(V) is *-isomorphic to some subalgebra of C*(X, $). For certain shifts, 
one can say more. If V is essentially (or almost) normal i.e. V*V - VV* € 
C(H), then except for D = Al, which we ignore, V is irreducible, so c*(v) > 
C(H) [2]. If K(H) denotes the compact diagonal operators, then D = C*(D) + 
K(H) C C*(V), and clearly D' - C*(V) for =D {Al}, so the proof 
of Theorem 1.4.1 shows that c*(v) is *-isomorphic to with Xo 
only locally compact here. In particular, every representation p consists of 
a pair (7, L), and p(V) = 7(D) - L. For an arbitrary shift thisis no longer true. 
In fact, one can show quite easily 


Theorem 2.3.1. C*(V = DU) has the property that for every irreducible 
representation p, p(V) = m(D) + L for some representation 7 of D and unitary 
operator L if and only if 


(O) 0 implies 0, allkeZ, 


One can go further and show that 


Theorem 2.3.2. C*(V) is a covariance algebra C*(X, $) if and only if 
V satisfies condition (O). 


Proof. The previous theorem shows the necessity. Let D* be the sub- 


algebra of C(V) consisting of all diagonal operators. Let A, = (vry*nyt/2 

and = (V*"V")*, all n> 1. As always D = C*({g"(D)}, C(X). If w 
€ X, then it follows from (O) that w(f"(D)) 4 0, all nm. But then using the fact 
that and B_ are in the “functions” in D* are seen to separate the 


points of X. D* is a *-algebra, so the Stone-Weierstrass theorem gives D*= 
D. If p* denotes {B € 9: B+ U” € C*(V)}, then pf contains the selfadjoint 
algebra D+ 9), the elements of which also must separate the points of X. Thus 
p* = 9D, each n, and the conclusion of the theorem follows. 


2.4, Algebraic equivalence. We turn now to the question of when two ir- 


reducible bilateral weighted shifts V, and V, are algebraically equivalent, 
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i.e. when does there exist a faithful representation 7 of c*(V,) with mV.) = 
V,. The first lemma shows that we may assume that V,, and hence necessar- 
ily V,, have closed range. 


Lemma 2.4.1. Let A € L(H) have polar decomposition A = UD, If a is 
any representation of C*(A) for which N(m(A)) = N(n(A*)) = {0}, then a has 
an extension to a representation of c*(A, U) on the same Hilbert space H,. 


Proof. From [8, Proposition 2.10.2] there exists an extension 7’ of 7 
to C*(A, U) such that H_, 2H, and 7'(B)|,, = 7(R), for all B in C*(A). 
Then 7 ‘Ala ‘Dy, implies, since 7 ‘(D)H, = by hypothe- 
sis, that 7 ‘WMH, 3 Similecly considering 7 "(A* ), one obtains 7 
CH. So nr is hie by H,, and the corresponding subrepresentation is the 
desired one. 

Returning to the irreducible weighted shifts V, and V,, we may now as- 
sume closed range. Let X,;_, i= 1, 2, denote their respective canonical diag- 
onal spectrum. Then 


Theorem 2.4.1, V, is algebraically equivalent to V, if and only if X,_ 


Proof. By Theorem 2.2.1, each c*(V.) is naturally *-isomorphic to 
C*(X x) where x is the usual shift on a product space, and under this *. 
isomorphism, V; is carried to F, in Cu... x), where F (1) = pg, the zero 
coordinate projection and F (nm) =0 if n # 1. Hence the sufficiency. 

If V, is algebraicaliy equivalent to V,, then c*(V,) is the image of a 
faithful irreducible representation p of C*(X x) with p(F,)=V,. By $11, 
if p= (a, L), then ., is transitive, and if it is based on the orbit of Xo, then 
p(F ,) is a shift whose weights have as their absolute values the coordinates 
of x,. But this sequence and its translates generatesX,_, so X,_C Xie 
and symmetry reverses the inequality. 

As previously remarked, if X = II {1, 2}, and x is the usual shift, then 
with respect to the usual product measure, almost every point has dense orbit. 
In this sense 


Corollary. Almost all bilateral weighted shifts whose weights are 1 or 2 
are algebraically equivalent, 


Remark. If the weights of a particular shift form an almost periodic func- 
tion on Z [19], then the diagonal spectrum X is a topological group. There 
is a natural homeomorphism of X onto a subgroup of wey and it is possible 
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to formulate a condition for algebraic equivalence in terms of this subgroup. 


2.5. N.G.C.R. shifts. Recall that a C*-algebra is said to be N.G.C.R. 
if it has no C.C.R. ideal [2]. So if V is any irreducible operator, C*(V) is 
N.G.C.R. means simply that C*(V) NC(H) = {0}. If V has closed range then 
C*(V) % c*(x, ¢) and known conditions apply [24]. In fact, these conditions 
are derived in Part I. Actually the same condition applies whether or not the 


range is closed. Let V = UD, where D = diagid, |, ez* 


Theorem 2.5.1. C*(V) M C(H) = {Q} if and only if there exists n,—> © 
with 
z 


Proof. We know that C*(V) is *-isomorphic to some subalgebra of 
C*(X, where X is the spectrum of D = and = UDU*. 
Let D* be the C*-subalgebra of C*(V) consisting of all diagonal operators. 
Let X" denote its spectrum. We shall see that D* isa *“large enough’’ sub- 
algebra of 9, so that we can work with it. 

Clearly, if the weights are periodic, C*(V) MN C(H) = {0}, so we may re- 
strict ourselves to the case of V irreducible. Then C*(V) NC(H) 4 {0} im- 
plies C*(V) NC(H) = C(H) [2]. Thus D* is a representation 7 of C(X") and 
so from the well-known structure of these [2], D* will contain rank one oper- 
ators if and only if 

(i) 7 is multiplicity free, and 

(ii) uw, has an isolated atom. 

For all k € Z, define in X" by w, (B) for B= diaglb } ez: 
Then fw, Inez is dense in X*, and it is seen that the measure Ly is purely 
atomic with atoms {w, 7 ez* 

Put A, = = dD), and BL =\VV""V" 

1(D), Since these all belong to by the continuing as- 
sumption of nonzero weights each w, has a unique extension to the obvious 
w, in X, In particular w; = w = (}*(D)) = w) (p*(D)), all k, =D 

is periodic. We assumed otherwise, so {w, i, ez is distinct, i.e. 7 is multi- 
plicity free. Thus we are reduced to considering whether wo is an isolated 
point of X" or not. But again, since wy (A) #0 and w,(B.) #0, a simple 

argument shows that we wy if and only if w, —> wo. Putting w, in canonical 


form, this is exactly the condition of the theorem. 


PART III. UNILATERAL WEIGHTED SHIFTS 


3.1. The generated C*-algebra. If H is a separable Hilbert space, an 


operator W is a unilateral weighted shift means that for some orthonormal 
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basis le} We, =d;e,,,, with d, € C, It is well known that such a W 
is irreducible if and only if each d; #0. We shall always assume this. Fur- 
ther, to unitary equivalence it may be assumed that d. > 0 [15]. Then W has 
polar decomposition W=S+ D where D = diagld } 7+ and S is the unilat- 
eral shift. 

If W has closed range, i.e. id, \ezt is bounded away from zero or alter- 
natively D is invertible, we can apply Theorem 1.4.1. With the notation in- 
troduced there, !, is generated by s*s5—~SS* a projection of rank one, Any 
ideal in an irreducible C*-algebra is irreducible, so I, = C(H) [2]. Now 


D = SMS} = 


since D has closed range, is commutative. Let X denote the spectrum of D. 
If g is the quotient map L(H) — L(H)/C(H), then qD) is also commutative. 
Denote its spectrum by 4X), and call it the essential diagonal spectrum of 
W. Now @ induces an automorphism of qD), and hence a homeomorphism, 
also denoted by ¢, of 94(X). Condition (C) is easily vezified so it follows 
that 


Theorem 3.1.1. If W is an irreducible unilateral weighted shift with 
closed range, then C*(W)/C(H) is *-isomorphic to the covariance algebra 


C*(qX), 


It is not difficult to do as in $2.3 and extend this result to certain types 
of shifts which do not necessarily have closed range. We omit the details. 

Since C*(W) contains the irreducible ideal C(H), it is known [2], [8] that 
every representation is a direct sum of two subrepresentations p, and p, 
with p,(C(H)) #0, and p,(C(H)) = 0. Then p, must be equivalent to a multi- 
ple of the identity representation, so with the representations p, of 
C*(¢(X), ¢) having been described in Part I, quite a good description of the 
representations of C*(W) is possible; in particular, a complete description 
in case W is G.C.R. Additionally, the conditions given in $1.3 characterize 
which C*(W)/C(H) and thence C*(W) are G.C.R. We must postpone the cor- 
responding characterization for those shifts without closed range until later. 

As was done for the bilateral operators, since D consists of diagonal 
operators, define w, € X,n=0, 1, 2, by w(B)=b, if B= diagtb } 
By the usual argument tw} ext is dense in X, 

Now ¢: D —SDS* and 1; D S*DS are both continuous, linear, 
multiplicative maps of D into itself, the former (1-1) and the latter onto. If 
the zero homomorphism is adjoined to X, then @ and g7! induce continuous 


nez* 


WEIGHTED SHIFTS AND COVARIANCE ALGEBRAS 


maps of X into X, whose action on iw} ezt is given by 


fw, ) if n>0, 
=0 if n=0 
and 


= w, ifn>0. 
Let X, = {0, w), X If y € then y=limw, = 
lim o &y)=y since do = idy, and ¢ is seen 
be a homeomorphism of X,. Of course X, is simply the essential diagonal 
spectrum 9(X). For, if x=limw, , and K € D is compact, then x(K) = 
lim w,, (K) =0. So x, C @(X). But q(X) CX is always true and clearly no 
point of X », except 0, is in g(X). So we have X, = q(X). 


We again consider the canonical form of the diagonal spectrum. Thus if 
x € X, let T(X) be as in (2.2). Then T is a homeomorphism of X into IT’ LY 
where Y is the spectrum of D, In particular T(w)) =(...,0,0,0,d,,d,, 
d,,-+-) and T(w,)=(...,0,0, d), d,,...), etc. and T(X) = 
= T(X)) + T(X, ), where + denotes disjoint union. 


Theorem 3.1.2. Let ¢ be a homeomorphism of a compact Hausdorff 
space Y. Then there exists a unilateral weighted shift W for which 
C*(W)/C(H) is naturally *-isomorphic to C*(Y, $) if and only if 

(i) Jf € C(Y, R) with tf o separating points. 

(ii) If T denotes the natural isomorphism 


then id, 150 , bounded, C R, such that if D=(..., 0, 0, 0, dy, 41, dy, oe) 
and x is shift, then (D)} = T(Y) + 


Proof. The remarks preceding the theorem show the necessity. For 
sufficiency, if we choose W =S+ (D+ 2 sup|d,| + 1), where S = unilateral 
shift, then the canonical form of X, described above shows that q(X) =X 
= T(Y), and hence that C*(W)/C(H) is indeed *-isomorphic to C*(Y, >). 


It is unfortunate that as even very simple examples show it is necessary 


l 


in the above to consider points outside Y. There is a simpler condition that 
is sufficient. 


Corollary. For sufficiency (ii) may be replaced by 
(ii)’ for some x € Y, either or - is dense in Y, 
n€ 


Proof. Just let d.= = {(67?(x)), i>0, in case {¢” is dense. 
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Among the many pairs (Y, ¢) to which the corollary applies are those of 
Examples 2 and 3 of Part II. 


3.2. N.G.C.R. shifts, As was previously remarked, an irreducible operae 
tor W is N.G.C.R. if and only if C*(W) NC(H) = {0}. 


Theorem 3.2.1. If W=S-+ D is an irreducible unilateral weighted shift, 
then W is N.G.C.R. if and only if there exists n, + +0 such that d.. 
if k>0 and if k<0. 


ite 


Proof. After the description of the canonical diagonal spectrum given in 
$3.1, the theorem is proven in exactly the same manner that Theorem 2.5.1 
was established. 

The condition is clearly not a vacuous one, so the existence of such 
shifts is established. The result may also be expressed as follows. 


Theorem 3.2.2. If W is an irreducible unilateral weighted shift, W = 
S+D, and D = -z), then C*(W) is N.G.C.R. if and only if 


is an isomorphism of ». 


Proof. kernel 67! = {diagib, 0, 0, 0, ... }}C C(H), so $~! is 1-1 if and 
only if 2 NC(H) = {0}. 


3.3. Algebraic equivalence. We want to consider when two irreducible 
unilateral weighted shifts are algebraically equivalent. Firstly 


Theorem 3.3.1. If W, is any irreducible unilateral weighted shift with 
closed range, then W, is algebraically equivalent to another shift W, if 
and only if = 


Proof. Notice that W, is not assumed to be irreducible. It is well known 
that W, is unitarily eqiuvalent to W, if and only if wiW, = WoW. Hence 
the sufficiency. For the necessity we must first show that W, is in fact 
necessarily irreducible. For this, suppose W, has polar decomposition W,= 
Ss‘. D,. Since W, has closed range, the unilateral shift S belongs to c*(w), 
and it is a consequence of Lemma 1.4.1 that if 7 implements the algebraic 
equivalence, then 7(S) = 5’. Hence S‘ is an isometry. But W, is a unilat- 
eral weighted shift, so it must be that S’ = S, i.e. W, is irreducible. 

Now since c*(w,) > C(H), and 7 is an irreducible representation, 7 
must be unitarily implemented [2]. So the conclusion. 

If W, is not of closed range, it is possible that W, be reducible, 

Example 4. Let W,=S+ D, where 
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D, = diag{l, 1, 1/2, 1, 1, 1/3, 1, 1, 1/4, ...3 
then W, has a three dimensional representation as the operator with matrix 


0 0 0 
1 0 0 


Thus W, has a faithful representation as the reducible shift with weights 

It is true for any irreducible operator that is not N.G.C.R., that every 
faithful irreducible representation is unitarily implemented. But we have seen 
that shifts with nonclosed range may be N.G.C.R. However, as has been true 
throughout most of this part, the unilateral case is not markedly different 
from the bilateral. 


Theorem 3.3.2, If W, and W, are irreducible unilateral weighted shifts, 
then W, and W, are algebraically equivalent if and only if X,_ =X, 
(where X,_ denotes the canonical diagonal spectrum defined previously in 


§3.1). 


Proof. Let p be the representation implementing the algebraic equiva- 
lence, Extend p to a representation p’ of C*(W, S) on some Hy DH, in 
the usual way [8]. If p is not unitarily implemented, then certainly both W, 
and W, must be N.G.C.R. Let W, denote W, with all the weights increased 
by one. Then p’ is an irreducible representation of c*(W,) x), 
for which p'(W,) is reducible and pW Dy = W,. This cannot occur unless 


p is a transitive representation based on the orbit of a point in | of the 


form {..., @_>,4_3,1, 1+ 1+ 4,,...} where ia} are irrelevant 
and W, has weights ia} ez But W, is N.G.C.R. so by Theorem 3.2.1 
some sequence of translates converges to {..., 1, 1, 1, 1+ a,;,1+4,,1+ 


Az, }. This says that 2X2.» so by symmetry we are done. 


3.4. G.C.R. shifts. For weighted shifts, either unilateral or bilateral, 
with nonzero weights and closed range, a characterization of those which are 
G.C.R. follows from $1.3. In [4], it is shown that any shift whose weights 
consist only of 0’s and I’s is G.C.R. More generally, suppose V =U D, 
(W=S-D,) is a bilateral (unilateral) weighted shift. Let Y, (Y,) be the 
subset of the diagonal spectrum X, (X,) given by Y, = {w € X,: if ukd*(D)) 
=0 then u(d**"(D)) = 0, all n>0 or all n 


Theorem 3.4.1. V (resp. W) is G.C.R. if and only if every point of Y, 
(Y,) is discrete in its orbit. 
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Proof. Since every irreducible representation of C*(W) is either unitar- 
ily equivalent to the identity representation or else is a representation of 
C*(W)/C(H) (these are not mutually exclusive) the argument for the unilateral 
case reduces to the following for the bilateral case. 

To every point of X, there corresponds the transitive irreducible repre- 
sentation of the covariance algebra C*(V, U) described in $1.1. If the point 
is in Y,, then by restricting to C*(V) and possibly taking a subrepresenta- 
tion, one obtains an irreducible representation p of V as a bilateral weighted 
shift or a unilateral weighted shift or the adjoint of the last. In any of these 
cases, if the point of U is not discrete in its orbit, then by Theorem 2.5.1 
or Theorem 3.2.1 it follows that p(C*(V)) M C(H) = {0}. Thus V is not G.C.R. 

Conversely, suppose p is an irreducible representation of C*(V) for 
which p(C*(V)) A C(H p) = {0}. Since V is a centered operator, it follows that 
p(V) is one [21]. If p(V) and p(V*) have zero null space, then by Lemma 
2.4.1, p extends to a representation p’ of C*(V, U), which is a covariance 
algebra, also on H ,. If p’ =(z, L) has H,, transitive, then p(V) is an N.G.C.R. 
irreducible bilateral weighted shift, and so by Thoerem 2.5.1, there exists y 
€ Y,, not discrete in its orbit. If u, is intransitive, then by Theorem 1.3.1 


there exist points in X,, in fact a set of nonzero measure of them, which are 


not discrete in their orbit. Then N(p(V*)) = {0} implies that some point in Y; 
has this property, i.e. N(M = {0} (fy: f(y) = 0}) =0. Finally, if 
(V) is an irreducible unilateral shift or the adjoint of one, then an argument 
almost identical to that at the end of Theorem 3.3.2 gives the conclusion. By 
the decomposition of centered operators given in [21], the above are the only 
possibilities for p(V). 
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ABSTRACT. Given a finite abstract group §, whenever n is suffi- 
ciently large there exist graphs with n vertices and automorphism group 
isomorphic to 8. Let e(G,n) denote the minimum number of edges 
possible in such a graph. It is shown that for each § there always exists 
a graph M such that for n sufficiently large, e(@,n) is attained by adding 
to M a standard maximal component asymmetric forest. A characterization 
of the graph M is given, a formula for e (@, n) is obtained (for large n), 
and the minimum edge problem is re-examined in the light of these results. 


1, Introduction. Throughout this paper, automorphism groups of graphs 
will be regarded as abstract groups rather than permutation groups, It is well 


known [1] that given any finite group G, there always exists a graph whose 


automorphism group is isomorphic to §. It is natural to consider the follow- 


ing problem: Given a finite group G, for each positive integer n decide 


whether or not there exists a graph on n vertices having automorphism group 
isomorphic to G, and if there do exist such graphs determine the minimum 
number e(G, n) of edges possible. For a survey of results leading to this 
and related problems see [4]. 

To date, this minimum edge problem has been completely solved only 
when @ is the identity grovp, a symmetric group, a dihedral group, or the 
cyclic group of order 3 [13], [14], [5], [3]. See also [16]. An examination of 
these cases reveals the following pattern. For small values of n, the behav- 
ior of e(S, n) may be somewhat erratic, due to the fact that the graphs for 
which e(G, n) is attained may fluctuate wildly, and for sporadic values of 
n no such graphs may exist. But eventually the situation becomes more 


stable: for n sufficiently large e(G, n) is always defined and, indeed, is 
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attained by adding to some fixed graph M a certain standard asymmetric 
forest. The point of the present paper is to show that this stability phenom- 
enon occurs in general, for an arbitrary group §. A precise statement of 
this result is given at the end of the next section. 


The theorem obtained characterizes M as a semireduced §-graph having 


minimum defect dy (see $2 for definitions) and a minimum number Vo of 


vertices. It establishes, for large n, the formula e(G, n)=n+ d, — c, where 
c denotes the number of components in a certain standard asymmetric forest 
on n—v, vertices. The basic properties of these forests are given in $3, 
and the proof of the stability theorem is given in $4, 

Some consequences of the theorem are examined in $5; the minimum 
edge problem is reformulated, and observations are made regarding the sta- 
bility graph M. These observations are applied, in $6, to the case where § 
is commutative, and the cyclic case is treated in detail. 


2. Preliminaries and notation. The bulk of the graph-theoretic terminol- 
ogy employed is in rough conformity with common usage [7], [11]. Throughout, 
all graphs are finite and undirected, without loops or multiple edges. Note 
that we permit the empty graph g@, which has no vertices or edges. 

For any graph G let v(G), e(G), c(G) denote, respectively, the number 
of vertices, edges and connected components of G. By convention, @ is not 
a component of G. The cycle rank of G will be denoted by r(G) and is 
given by r=e-—vu+c. We introduce the defect d(G) defined by d = 

An automorphism of G is a permutation of the set of vertices of G which 
preserves adjacency. The collection of all automorphisms of G forms a group 
which will be denoted by (fut(G). The notation @ut(G)~> 8 will mean that 
(@tut(G) is isomorphic (as an abstract group) to the group &; in this case we 
refer to G as a G-graph. The identity group with only one element will some- 
times be denoted by id, and an id-graph is termed asymmetric. By convention, 
@ is asymmetric. 

Throughout, all groups are finite. The symmetric group of order m! is 
designated by 5 and 5, [GC] denotes the wreath product of § by 5° This 
last group is defined concretely in [12] and in [9, $3], and an abstract de- 
scription is given below. Begin by taking the direct product of m copies of 
G; say D=G, x where Let act on J) by per- 
muting the subscripts in the natural manner. Finally, 5, [G] is the semidirect 
product of J) by 5, using this action. For details see [10, Chapter 6] or 
[9, $21. 
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Wreath products arise naturally as automorphism groups of graphs all of 
whose components are isomophic [2]. In general, suppose G = m,G,+m,G,+ 
. + m,G, where the G, are connected, G; is not isomorphic to G; for 
i if j, the symbol + hentee disjoint union, pa mG, is the disjoint union of 
m, copies of G.. If Qut(G.) then @ut(G) 1S, |x JS, 

If C is a connected nonempty graph, the multiplicity of C in a graph G 
is defined as the number of components of G which are isomorphic to C, It 
follows from the preceding remarks that in a nonempty asymmetric graph all 
components have multiplicity 1. A graph G is said to be reduced if G has 
no proper subgraph H which is a union of components of G such that (lut(H)Y 
(tut(G). Equivalently, G is reduced if and only if G has no asymmetric com- 
ponents of multiplicity 1. Observe that the empty graph is the only reduced 
asymmetric graph. It is clear that every graph G can be decomposed in a 
unique manner as R+A where R is reduced, A is asymmetric and Qut(G)¥ 
(tut(R). 

Let a(G) denote the number of nonisomorphic asymmetric components of 
G, and let a,(G) be the number of nonisomorphic asymmetric components of 
multiplicity > 1 in G. Observe that if C is an asymmetric component of 


multiplicity m in G, then (fut(G) has a direct factor isomorphic to § lid] = 
5 Using the uniqueness of the direct product decomposition of a finite group 


into indecomposable factors [6, p. 130] and the indecomposability of ae it 
follows that a,{c) cannot exceed the number of nontrivial symmetric groups 
which appear as direct factors in the decomposition of (lut(G), and the multi- 
plicities m, of these asymmetric components must equal the degrees of the 
corresponding symmetric groups Sin; . 

Let s(G) denote the number of nontrivial direct factors in the standard 
decomposition of G (into directly indecomposable groups) which are isomorphic 
to symmetric groups. We have just remarked that a,(G) < s(G) for every G- 
graph G. We say that a §-graph is semireduced if a(G)< s(G). It is easy to 
see that the semireduced §-graphs are precisely the graphs R+A where R 
is a reduced §-graph and A is a graph having at most s(G) - a(R) components, 
each of which is asymmetric and of multiplicity 1 in A and not isomorphic 
to any component of R. In particular, every reduced §-graph is semireduced. 
Note also that when s(G) = 0, every semireduced G-graph is reduced. 


We are now prepared to state our main result. 


Theorem. Let G be any finite group. Let d, denote the minimum defect 
d(S), where S ranges over all semireduced §-graphs; among all such graphs 


30 D. J. MCCARTHY AND L. V. QUINTAS 


which satisfy d(S) = d, let M be one having the smallest number of vertices v4. 

Then for n sufficiently large, e(G, n) =n +d, - where m= 
n-v,. and s= s(G). Indeed, M can be chosen so that e(G, n) is attained 
by M+ 


In the above, the graph - 
m vertices and a maximum number of components none of which is isomorphic 
to any member of a fixed set of s trees. The graphs Q . are defined pre- 


is a certain standard asymmetric forest. It has 


cisely and their properties are investigated in the following section. 


3. Standard asymmetric forests. Throughout we shall assume that all 
nonisomorphic asymmetric trees have been enumerated in some fixed order, 
T,, Tz, T3, «++, subject only to the condition that the trees are listed in 
order of increasing number of vertices, i.e. v(T,) < v(T;4,). 

Following Quintas [13], we define a graph Q, having n vertices, ob- 


tained essentially by taking an initial segment of this standard list of asym- 


metric trees. More precisely, suppose c is maximal so that v(T, + Ty T) 
< n. If equality holds here, take Q., =T,+T,+..-+ To otherwise we 
modify this slightly, replacing T_ by the first tree T, in the list having ex- 


actly n- v(T, vertices. Clearly is asymmetric, and 


c= c(Q) is the maximum number of components in any asymmetric forest on 
n vertices, Since asymmetric trees on n vertices exist except when 1<n< 
7, we see that Q is defined for m= 1 and n>/7. 

We now make a slight generalization of this construction. In what follows, 
& will denote a finite collection of nonisomorphic asymmetric trees. The 
graph Q (%) is defined by precisely the same procedure as above, but after 
first deleting the elements of S from our standard list of asymmetric trees. 
When 2 = we have Q (3) = and letting ={7,, Tz ..., 7,} define 
a = 0 (S.). A graph G is said to be %-free if each element of 2 has 
multiplicity zero in G. 


Lemma 1. If A is an asymmetric S-free graph then d(A) > d(Q (3)) 
uhenever is defined and n> v(A). 


Proof. If C is a component of A then d(C) =-1 if C is a tree, and 
d(C) > 0 otherwise. Thus if cy denotes the number of components of A which 
are trees, we have d(A) > - Co: Each of the cy trees which occur as compo- 
nents of A is isomorphic to exactly one term in our standard list of asym- 
metric trees and none lies in 2. 't follows that the total number of vertices 
in the sum of the first cy trees in the list obtained by deleting & from the 
standard list is at most v(A). Since n> v(A), it is clear from the construction 
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that (S) has at least cy components. Thus d(Q = - c(Q(8))< 
-¢,<d(A). 0 

Since e = v +d in general, it follows from the above result that Q (8) 
is a minimum edge graph among all asymmetric S-free graphs on n vertices. 
When & = @ this yields e(id, n) = e(Q) whenever Q, is defined, as shown 
by Quintas [13]. 


Lemma 2. Given S& and a fixed integer k > 0, we have 
~1< dO, - AQ <0 
provided only that n is sufficiently large. More precisely, there exists 


an integer N,(%) so that whenever n > N,(3), Q (3) exists and the above 
inequalities hold. 


Proof. Assume for the moment that Q (Z) exists whenever n is suffi- 
ciently large. Let x = ~ d(Q (3)). It is clear (e.g. from Lemma 
1) that x < 0 whenever both Q,,(%) and Q (%) are defined. Observe that 
- x is the number of components by which Q ,,(3) exceeds Q (2). Thus if 


n is so large that Q (8) already includes all available trees on at most k 
vertices, then clearly — x < 1 as desired. 

To complete the proof we need only obtain an integer N, (2) such that 
Q (3) exists whenever n > N,.(3). Then N, (8) can be taken as the larger 
of and v(F,(%)), where F,(3) is the sum of all nonisomorphic asym- 
metric %-free trees on at most k vertices. Suppose m is an integer such that 
whenever n> m there exists a 2-free tree on n vertices. Letting F = 
aoe (8) it is clear that we can take No) = m+ v(F). Finally, we observe 
that m can be any integer > 7 which exceeds the maximum number of vertices 
of any tree in %. For this last, we need only note that there exists an asym- 
metric tree on vertices whenever n> 7. O 

In what follows, we let N, .=N AC. pS It will also be important in the 
sequel to obtain an integer N Ko} wah that Q (&) exists for m > No(t) when- 
ever & contains at mést ¢ trees. To do this, assume ¢>0 and suppose m 


t 
is an integer such that the number of nonisomorphic asymmetric trees on m 


t 
vertices exceeds t. Clearly n> m, guarantees the existence of a $-free 
tree on n vertices for all collections containing at most ¢ trees. Thus if 
F denotes the sum of all nonisomorphic asymmetric trees having fewer than 
m, vertices, we can take Not) =m,+ v(F). 

The existence of m, follows from the well-known fact that ai the number 
of nonisomorphic asymmetric trees on n vertices, grows arbitrarily large with 
n. (This can be seen as follows. For n> 7, start with a path of length n - 2, 


with vertices labelled consecutively as v,, v,,---,U,_,- At vertex v; 
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append a path of length 1 to obtain a tree G; having nm vertices. For 2< 
i<(n- 1)/2 the G, are asymmetric and mutually nonisomorphic. Thus a, > 
[(n - 1)/2] - 2 = [(n - 5)/2]. Better information on a, can be obtained from 


[s].) 


4, Proof of the stability theorem. We begin by observing that for any group 
G, there exist G-graphs on n vertices whenever n is sufficiently large. For 
suppose Gp is any G-graph; existence of Gy is guaranteed by [i]. Let 3 
denote the set of nonisomorphic asymmetric trees having multiplicity > 0 in 
G,, and consider Gy + Q (8). This is a G-graph on n = v(G,) + m vertices, 
existing whenever n > v(G,) + N,(S). 

We wish to show that for n sufficiently large, the minimum number of 
edges for all G-graphs on n vertices is given by 


(4.1) e,=n+d,-cQ,, ,) 


s 
statement of the theorem. We prove the latter part first. 


and that e, is attained by a graph of the form M + 2... as indicated in the 


Thus, suppose M is a semireduced G-graph attaining minimum defect 
d, and having minimum number of vertices vg. Letting s = s(G) as defined 


in $2, consider the graph M + Q on n= Uv, + m vertices. This graph 


m,s 


exists for n> v9 +N, , but need not be a G-graph, since an asymmetric com- 
ponent of M may be repeated in Q .. In that case, however, in view of the 
minimality of vg any such component must have the same number of vertices 


as some element of Se not appearing in M. It is possible to replace all oc- 
currences of such components in M by appropriate elements of 5 to obtain 
a semireduced §-graph M, whose asymmetric components all come from 3. 
We have d(M,) = do, v(M,) =v, and G =M,+Q 
vertices with e(G_)=n+d(G)=e, as desired. 


is a §-graph on n 
To complete the proof of the theorem, suppose G is any §-graph on n 
vertices; we will show that e(G) > e,, provided only that n is sufficiently 
large. Again let s= s(G), m=n- vv, and write G=R+A where R isa 
reduced G-graph and A is asymmetric. Decompose A as A, + A, where A, 
is the sum of all those components of A isomorphic to elements of B . Let 
Y=. U BR), where 8(R) denotes the set of all asymmetric trees having 
multiplicity > 0 in R. Thus G=(R+A,)+ Ay and A, is S-free and asym- 
metric. We distinguish two cases, according as R + A, is semireduced or not. 
Case 1. R+A, is semireduced. Observe that e(G)-e, = x+y where 
x= d(R+A,)-d, and y=d(A,)-d(Q, ,). In the present case we have 
x > 0, and by Lemma 1, y > 0 provided v, > vp, where v, = v (R + A,). Thus 
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assume v, < vp. By the minimality of vy we have x > 0, hence need only 
show y>- 1. Let k= v)-v, so that v(A,)=m+k. Since k>0,0,4, 
is defined whenever n (and hence 1) is sufficiently large, and since A, is 
$-free we have d(A,) > Thus y > +k,s) and the 
desired result follows from Lemma 2. More precisely, we obtain y >- 1 
whenever n> vp + Nevs where k = vy — v; < Vp. So in any event, x + y>0 
whenever n> vp + 

Case 2. R+ A, is not semireduced. If we let a(R + A,)= s+ then 
0<t<-s and it is clear that A, has at least ¢ components and that R has 
at least t nonisomorphic asymmetric components not lying in 3 Let C,, 
Ci, +25 C, be such a set of components of R, and let D,, D,,..., D, be 
components of A.. Let m, be the multiplicity of C; in R and, finally, let 
H be the graph obtained from R+ A, by replacing m;- 1 copies of C; by 
copies of D;. Thus if we let C = &(m,- 1)C; and D=2(m,-1)D,, we have 
H=R+A,-C+D. 

Observe that if Q is any asymmetric S-free graph and G’ = H+Q, then 
G' isa G-graph and in the decomposition G' = R'+ A‘ + the C. appear 
only in AL; hence R’ + At is semireduced. By Case 1, we have e(c’) >e 
provided only that n' = v(G’) is sufficiently large. Thus if we can select Q 
so that n=n' and e(G) > e(G’), the desired result follows. We shall see 
that such a selection is possible provided v(C) is sufficiently large. In the 
remaining case, i.e. when v(C) is bounded by an appropriate constant, we 
make a different selection of Q which does not yield n’ = n. Nevertheless, 
the boundedness of v(C) guarantees that n’ is large whenever n is suffi- 
ciently large, and we are still able to obtain e(G) > e,: The details are 
presented below. 

Symbolically we may write G- G’= C-D+A,-Q. If we let k = v(C)- 
v(D) + v(A,) then n-n' =k-v(Q). If v(C) is sufficiently large, k > v(A,) 
and Q,(%) exists. Taking Q = Q,(3) gives n'=n and e(G) > e(G’) as 
desired. (Since here e(G) - e(G’) = d(G) - d(G’) = r(C) + d(A,) - d(Q) and, 
via Lemma 1, d(A,) > d(Q).) It is not difficult to obtain a crude bound K so 
that v(C) > K guarantees the appropriate conditions on k. E.g. v(C) - v(D) 
> No(2s) ensures the existence of Q,(3). If we let 


L=uAS.)-. (m;,-1) 
lsi<s 
then certainly v(D) < L; hence we can take K = L + N (2s). 


Now we turn to the case in which v(C) < K. Here we select Q = A,, so 


that G’ = G- C+D. Consider the bracketed terms in the decomposition of 


| 
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e(G)-e, as te(G) - e(G')} + fe(G’) - Since c(G’) = 
c(G), we have e(G) - e(G')=n-—n'+ r(c). Also, - €, = n'—-n+z 
where z= d(Q - 42, and m' =n' Thus e(G)-e, ={e(c’)- 
+ r(C) + z. Since = v(C) - v(D), the assumption that <K 
hanlies that n’ >n-K. This guarantees that for n sufficiently large we 


have e(G’) > e,'+ (E.g. this is assured if n> K+ v9 + N.. s and in what 


follows we assume 7 is at least this large.) 

So we need only show that 7(C) + z>0 provided n is big enough. If 
v(C) > v(D) then n>n’, hence z>0 via Lemma 1. Since always r(C) > 0, 
there is nothing further to prove here. Thus suppose v(C)< v(D). We will 
show that this implies r(C) > 0, hence require only z >- 1. By Lemma 2, 
this last condition is met whenever 7 is sufficiently large (e.g. whenever 
n>v +N, ; for any integer / > v(D) - v(C); in particular we may take / = 
L). To see ‘that r(C) > 0, simply observe that v(C, )> v(D, ) whenever C; 
is a tree (since D; lies in 3. but C; does not). Thus the assumption thet 
v(C) < v(D) implies that C cannot be a forest. 

Thus in all cases, e(G) > e,, whenever n is sufficiently large. In fact, 
we have shown that this holds whenever n> v) + L +N where N is the 
maximum of N (2s), N and 


v0,s 


5. Consequences of the main result. It follows from the theorem just 
proved that for an arbitrary group G, as n grows large e(G, n) grows at the 
same rate as e(id, n). Indeed, for all n sufficiently large we have 


(5.1) dy+s<eG, n) — e(id, n)<dy+s +1. 


To see this, use the fact that for nm large enough 


(5.2) elid, n) = =n-c(Q) 


and e(G, n) is given by (4.1) with m=n- v, and s = s(G). Observe also 
that if wu. = v(T, T.) and n’ = u,+m,then =T,+T,+ 
-+T,+ hence 


(5.3) eG, 


Thus e(G, n) - e(id, n) = d,j+s+x where x=c(Q)-c(Q,). It is easy 
to see that vp, > u,, so that n> n' and an application of Lemma 2 yields 
0<x< 1 as desired, 

In view of the above, the rate of growth of c(Q) may be of some interest, 
as is the problem of reasonably explicit’ computation of these numbers. In 
this regard, we remark only that c(Q) can be described as in [13] in terms 
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of a,, the number of nonisomorphic asymmetric trees on k vertices. Let 
A, = la, + 2a,+...+ ja; and let w be maximal subject to A, <n. Then 


c(Q,)=a, +a,+...+4,+w, where w is the greatest integer in 


(n - A )/(u + 1). Although no closed formula for a, is known, the generating 


function for this sequence is obtained in [8]. 

Leaving aside the problem of actual computation of c(Q), in view of 
our stability theorem the complete determination of e(G, n) for all n can be 
separated into several distinct subproblems: 

(i) determine the values of s(G), d, and v9; 

(ii) determine the point at which stability first occurs; i.e. find the 
smallest integer N, such that e(&, n) = e,, for n>No; 

(iii) investigate the behavior of e(G, n) when n< No- 

It is hoped that this reformulation may be helpful in future work on the 
minimum edge problem. The stability result obtained here has little direct 
bearing on (ii) and (iii), although it is possible that in particular instances 
some of the ideas used in the proof may be of assistance. With regard to (i), 
computation of s(G) is a purely algebraic problem, of course, but determina- 
tion of d) and v, may involve both algebraic and graph theoretic techniques. 


Also, (i) is closely related to the problem of actually exhibiting a ‘‘stability 
gtaph’’ for G, that is, a semireduced G-graph M with minimum defect and 
which attains the minimum number of vertices among such graphs. We offer 
several observations on the structure of M. 

While the stability graph for a given group § is by no means uniquely 
determined, some uniformizing assumptions can be made. In order to attain 
the minimum defect d, among semireduced G-graphs, M must contain pre- 
cisely s = s(G) nonisomorphic asymmetric components. Since we also require 
M to have the minimum number v, of vertices, we may take these components 
to be the trees T > T,, eee Ty and if m; denotes the multiplicity of T; in 
M we can also assume that m,>m,,, for l<i<s. 

lf M is reduced (i.e. if m., > 1), the m, are just the degrees of the non- 
trivial symmetric direct factors of G, and we have 


M=m,T, +m,T, +My 


where My is a reduced G -graph. Here go is a direct factor of G which is 
maximal subject to s(G o) = 0. It is clear that My is a stability graph for a 
and it follows that My has no asymmetric components. 

If the stability graph M always turned out to be a reduced @-graph, we 
could confine attention to groups with no nontrivial symmetric direct factors, 


for in view of the above observation, the general situation would present no 
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additional difficulties. Unfortunately, this is not the case. 

For example, if 5, appears as a direct factor of G, then the stability 
graph M is definitely not reduced whenever s(G) > 1. For suppose M were 
reduced. We assume that for i< s,.T; has multiplicity m;> 1 in M, and 
m , = 2. Consider the graph M, obtained from M by replacing one copy of 
Ri by a path P, of length 1. Then M, is a semireduced @-graph having 
the same defect as M but with fewer vertices. This contradicts the minimality 
of vo. 

We remark that although M itself need not be reduced, there always 
exists a reduced G-graph R so that e(G, n) is attained for large n by R + 
Qu i where n’ = n~v(R) and t= a(R). (To see this, just take R to be 
the reduced part of the stability graph M.) This fact would be much more 
interesting if we could give a direct characterization of R, or at least of 
v(R) and possibly a(R). In some instances, R may be described in exactly 
the same manner as M. More precisely, let d, be the minimum defect of all 
reduced §-graphs, and among such graphs attaining d, let R, be one having 
the smallest number v, of vertices. For many groups § we have R = R,- 
If this were always the case, the emphasis on semireduced graphs in the 


theorem would be misplaced. We give an example in which this is not so. 


Let § = 5, x 5,. We have s(G) = 2 and it is easy to see that d,=-5, 
v, = 17 and R, = 3T, + 2T,. However, dy =- 5, vg = 12 and M = 3T, + 
P,+T, where P, is a path having two vertices. Thus R = 3T, + P, #R,. 
More important, for infinitely many n, e(G, n) is not attained by R, + 
For, letting m= n—- 12 and m' =n-17 we have c(Q,, 2) > 
and hence e(M + <e(R,+ whenever n = v(M + F ) 
where T, + T, + F, is the sum of the first ¢ trees in the standard list. 


We make one final observation. There always exists a graph M’ such 
that for n sufficiently large, e(§, ) is attained by M’ + Qs where n' = 
n—v .+u, as in (5.3). To see this, simply select M so that T; has multi- 
plicity >0 in M for l<i¢s. If M=M'+T,+...+T, then M+Q, 
M‘ + Q + Of course, M’ will not generally be a G-graph. 


6. Application to the commutative case. A good general description can 
be given for the stability graph of an arbitrary commutative group. Assume 
in what follows that G is commutative. Let s = s(G) and let Go denote a 
maximal direct factor of § with s(§,) = 0. When s=0, § = _# When s>0, 
C= g. x Go where Gg. is the direct product of s copies of a cyclic group 
of order 2. 

We will employ the following result whose proof is omitted. 
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Lemma 3. Let C be a component of multiplicity m in some G-graph, 
where § is commutative. 

(1) If m> 1, then m= 2, C is asymmetric, and § has a direct factor 
of order 2 arising from C, 

(2) If C is a tree, then (tut(C) is either trivial or a direct product of 
cyclic groups of order 2. 

(3) If C is unicyclic and (ut(C) has no direct factors of order 2, then 
Qut(C) is cyclic. 


Suppose now that H is a semireduced G-graph. It follows immediately 
from (1) and (2) that d(H) > — 2s. Moreover, if equality holds here then a 
good deal can be said regarding the structure of H. Assume d(H) = - 2s 
and s>0. We can write H=H, +H, where H, has precisely 2s components 
each of which is a tree whose automorphism group has order < 2, and each 
component of H, has defect 0, i.e. is unicyclic. Furthermore, to obtain 
c(H_.) = 2s it is necessary that a(H.) =s and ut (H .) has order 2°. It 
follows that H. is a semireduced ,-gtaph and Hp, a reduced 
Also, if C is a component of H, then C has multiplicity 1, is unicyclic and 
@ut(C) is cyclic of order > 2. When s = 0, Hy = H and has the same struc- 
tural properties as when s > 0. 

Further insight into the structure of the components of Hy is provided 
by the following observation. Let U be an asymmetric unicyclic graph, and 
q> 2. Let U(q) denote the unicyclic graph on q+ v(U) vertices obtained 
by taking the natural q-fold covering of U. (If we regard U as a necklace, 
then U(q) is obtained by unclasping U, taking q copies of this unclasped 
necklace and joining their clasps in the most natural manner.) It can be 


shown that Qut (U (q)) = C.. the cyclic group of order g, and that every uni- 


cyclic C-gtaph arises in this manner. A detailed proof will be provided 
elsewhere. 

Finally, we show that d, = - 2s by exhibiting a semireduced G-graph 
H with d(H) =- 2s. Take H =2(T, + T,+...+T7,)+Hg where Hy is 
as follows. Decompose Go as a direct product of cyclic groups in some 
manner, and let the orders of the factors in this decomposition be 71» Y»+++» 
q,- Let U;, U,,..., U, be asymmetric unicyclic graphs chosen so that 
whenever q; = qj with i # j, U; is not isomorphic to U;. Take Hy to be the 
sum of the graphs U (q;) for 1<i< k. Each component of Hy has multi- 
plicity 1, hence Hy isa Go-graph. It is clear that H meets the desired 
conditions. 


We can obtain a stability graph M for G by modifying the above construction 
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to attain a minimum number of vertices. In more detail, it is clear from the 
result on the structure of semireduced @-graphs of minimum defect that it is 
sufficient to obtain stability graphs My, M, for Gas Gg. respectively. Set- 
ting M=M,) when s=0, and M=M_+M, when s>0 yields a stability 
graph M for G. 

When s >0, M, is obtained as follows. Consider all nonisomorphic 
trees having automorphism group of order < 2, and list them in order of in- 
creasing number of vertices: W,, W,,.... Take 

clearly M, is a stability graph for G 

It is easy to describe an explicit procedure for obtaining Mj, but we 
gloss over the details. The procedure can be summarized as follows. To 
each decomposition D of Go as a direct product of cyclic groups we assign 
a standard minimum-vertex ¢ o-graph Mp whose components are unicyclic 
and have the factors appearing in D as their automorphism groups. If D is 
such that v(Mp) is a minimum, we take My = Mp. 

The explicit description of M, has been omitted here, but is not hard 


to reconstruct. The numbers v(Mp) can be described entirely in terms of 


the orders of the factors in the decomposition D and the sequence b,. Here 


b, denotes the number of nonisomorphic asymmetric unicyclic graphs on k 
vertices; the generating function for b, is known [15]. There seem to be 
genuine subtleties involved, however, in deciding which decomposition D 
minimizes u(Mp). For a specific group Go this can be settled by straight- 
forward computation, of course, but the outcome in the general case cannot 
readily be described in simple terms as yet. There is, however, an important 
special case in which the result is clear. 


Theorem. Let 4, 92, +++, 9, denote the orders of the factors in the 
decomposition of Go as a direct product of cyclic groups of prime-power 
order. If 2 for i#j (1 <i, j<¢ k), then My =C,+C,+...+C, 
where C;= U(q,) and U is the unicyclic asymmetric graph on 6 vertices. 
In particular, v(My) = 6(q, + +--+ + %)» 


As an immediate corollary, we obtain the following explicit description 
of the stability graph M in the case when G is cyclic. Suppose G is cyclic 
of order 7 = 9,9, --- 4, where the q; are powers of different primes. If 
q # 2 mod 4, then s(G) = 0, hence M = M, as in the theorem. In particular, 
d,=0 and Vo = 6G where 7 = 9, +4,+---+4- lf q= 2 mod 4, then 
s(G) = 1, hence §, is cyclic of order g/2. We have M = 2T, + My where 
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M, is the stability graph for Go» as above. In particular, d) =- 2 and v, = 
2+6(% - 2). 
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ABSTRACT. The term character in this paper will denote the character 
of a group element under a general or indeterminate representation of the 
group in the special linear group of 2 x 2 matrices with determinant 1; the 
properties of characters of this type were first studied by R. Fricke in the 
late nineteenth century. Theorem 1 determines the automorphisms of a free 
group which leave the characters invariant. In a previous paper it was shown 
that the character of each element in the free group Pu of finite rank n can 
be identified with an element of a certain quotient ring of the commutative 
ring of polynomials with integer coefficients in 2” ~ 1 indeterminates. It 
follows that any automorphism of F_ induces in a natural way an automor- 
Phism on this quotient ring. Corollary 1 shows that for n > 3 the group of 
induced automorphisms of Fa is isomorphic to the group of outer automor- 
Phism classes of F The possibility is thus raised that the induced auto- 
morphisms may be useful in studying the structure of this group. Theorem 2 
gives a characterization for the group of induced automorphisms of F, in 
terms of an invariant polynomial. 


1. Introduction. The algebraic properties of group characters under rep- 
resentation in the two-dimensional special linear group were first studied by 
R. Fricke [1] in connection with problems in the theory of Riemann surfaces. 
Although Fricke was primarily concerned with analytic questions, his work 
has led to results of group theoretic interest. Further results on free groups 
and related results have recently been given by the author [2] and A. Whitte- 


more [5], [6]. Fricke in [1] observed the existence of naturally induced 


automorphisms on the ring of polynomial expressions in the characters of the 
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group elements arising from the automorphisms of the group. The present 
paper investigates the induced automorphisms on the characters of free groups 
and their relationship to the automorphisms of the groups. 


2. Preliminaries. SL, will denote tne special linear group of 2 x 2 ma- 
trices with determinant 1 over the real or complex numbers. If G is a group, 
xu will denote the character of the element u € G under a general or inde- 
terminate representation of G in SL,. By this we mean that any relation 
which we write among the characters of elements of G will be understood 
to hold identically for al! possible representations in SL,. If we let Ro de- 
note the set of all representations of G in SL,, and let FR. C) denote 
the ring of functions from Ro to the complex numbers with the usual addi- 
tion and multiplication, then the symbol yu can be regarded as formally de- 
noting the function in FR. C) which assigns to each representation p € 
RK. the character trace p(u) of u under p. The relations [1, p. 338] 


(1) = xu, 


(2) = xuxv — 

hold for all u, v € G, and can be readily verified from the corresponding re- 
lations among the traces of arbitrary matrices in SL,. The statement of the 
following result is due to Fricke [1]. A proof is given in [2]: 


The character of an arbitrary element u in the free group F, on the n gen- 


erators @,, @,,-++, @, can be written as a polynomial expression 


n 


with integer coefficients in the 2” ~ 1 characters 


where <i, l<v<n. 


The polynomial expression (3) is obtained by repeated application of 
the formulas (1), (2) to the freely reduced word representing u. 


The following two lemmas will be used in the next section. 


Lemma 1. Let F be a free group on two or more generators a, b,+++. If 
u €F is such that au~'bu is conjugate to ab (or ba), then u = b!a™ for 


some integers l, m. 


The proof of Lemma 1 is a standard cancellation argument. Let U be 
the freely reduced word representing u. Let U = b'va™ where V is freely 
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reduced, V not beginning with a power of b nor ending with a power of a. 
Then aV~!bv = a™(aU~'bU)a~™ is conjugate to ab. But aV~'bV is cyc- 


lically reduced as written. Therefore V must be the empty word. 


Lemma 2 [2, Theorem 7.1]. Let u be an element of the free groub F. If 
xu = xg™ where g™ is a power of a primitive element g, then u is conju- 
gate to g™ or g™™. 

3. Automorphisms leaving the characters invariant. We shall say that an 
automorphism a of the free group F leaves the characters of F invariant 
if xu = xa(u) for all u € F. 


Theorem 1. Let I denote the group of automorphisms of the free group 
F which leave the characters of F invariant. If F has infinite rank, or if 
F has finite rank greater than or equal to three, then I is the group of inner 
automorphisms of F. If F has rank two, then I is the group generated by 
the inner automorphisms of F together with the automorphism which maps 
the two generators of F onto their inverses. If F has rank one, then I con- 


sists of the two automorphisms of F. 


Proof. The only automorphisms of F, are the identity automorphism and 


the automorphism u 


which clearly leaves the characters of F, invar- 
iant by (1). Therefore we may restrict our attention to free groups of rank 
greater than or equal to two. Let a, b be the two generators of F,. By (3), 
(4) it follows that the character of any element in F, can be represented as 
a polynomial expression in the three characters ya, yb, yab. The image of 
this element under the automorphism @ > a~ 1 b-b7! will be the same ex- 
pression in xan}, Since = xa, xo7! = xb, pn! 
= xba = xab by (1), it follows that the automorphism aaa~!,b7b7! 
leaves the characters of F, invariant. Clearly any inner automorphism leaves 
the characters of F invariant. Suppose conversely that @ is an automor- 
phism of F which leaves the characters invariant. We shall show that a 

is an inner automorphism or, in the case of F,, the composition of an inner 
automorphism with a+ a~!, b+ b~', Let S be the set of free generators 
which define the words of F. Let g €S. Since a leaves characters invar- 
iant, it follows by Lemma 2 that a(g) must be conjugate to g or g7'. There- 
fore 


(5) a(g) = ue 1 


for some u, € F and e(g) = +1. Let @ be a fixed element in S. Set u, =v 


and ¢(a) = «. Then (5) becomes 


(6) ala) = 
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when g=a. Let o= +1, and let g €S with g#a. Then since ag” isa 
primitive element of F and @ leaves characters invariant, Lemma 2 implies 
that 


(7) alag?) = w~ (ag?) w 


for some w €F and n= +1, Since a(ag”) = a(a)la(g)]”, we conclude from 
(7), (6) and (5) that 


(8) \ag?)" w = 1,7€(e 


The exponent sums on the left and right sides of (8) must be equal. Hence 
(9) (1 + o)n = € + oelg). 

Alternately setting @=-1 and o=+1 in (9) we obtain 

(10) Ag) =€ 


and =e. If we set o=+1 in (8), substitute 7 = eg) = €, multiply on the 
left by v and on the right by v~ 1 we obtain 


€ 1 


Since «= +1, a® and g* are a pair of primitive elements for F. Therefore 
Lemma 1 implies that uv! = gil(a)gem(a) for some integers /(g), m(g) de- 
pending on g €S. If we substitute (10) and “2 gil(aigem(8)y in (5), we con- 
clude that 


for all g €S with g#a. Let g,h €S with g#h, g,h#a. Then gh isa 
primitive element of F, and by (12) 


algh) = alg)alh) = gem (a )—Em(h gem(h),, 


If we take characters of both sides using the fact that a leaves characters 


invariant and conjugate elements have the same character, we obtain 


(13) xgh = (a )—€m dp (h 


Now since gh is a primitive element, it follows by Lemma 2 that the argu- 
ment of the right side must be conjugate to (gh)*!. But this is impossible 
unless m(g) = m(h), for otherwise, since a, g, h are distinct generators of F, 
the right side of (13) is cyclically reduced and has four syllables. Therefore 
m(g) has a common value m for all g € S, g 4a. Thus (12) becomes 
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(14) a(g) = 


for all g €S with g#a. (14) is also clearly valid for g = a, for in this case 
(14) is equivalent to (6). Thus (14) holds for all g € S. If €=+1 in (14), we 
see that @ acts as a conjugation by av on every generator g € S, and con- 
sequently on every element of F. Therefore, if ¢€=+1, @ is an inner auto- 
morphism. Suppose that ¢=-—1. Then (14) becomes 


(15) a(g) =v 1g™ 1g-my 


for all g €S. Let g, h €S with g#h, g,h#a. Then 


a(gab) = a(g)ala)a(b) = 


by (15). If we take characters on both sides using the fact that a leaves 
characters invariant and conjugate elements have the same character, we ob- 
tain ygah = yg~!a~'h-!. However if g, h, @ are distinct generators of F, 
this contradicts Lemma 2, as then gah is a primitive element of F, while 
g7 am Ip-l is clearly not conjugate to (gah)*, Hence in this case there 
can be at most two generators in S, Since we are assuming F is not F, it 
follows that S has exactly two generators, and from (15) we see that @ is 
the composition of an inner automorphism with the automorphism which maps 
each generator onto its inverse. 


4, The induced automorphisms. Let - Jenote the commutative ring of 
polynomials with integer coefficients in the ,2” — 1 indeterminates etna 
iy’ Let f denote the ideal consisting of all polynomials in at which van- 
ish identically when the characters (4) are substituted for the corresponding 
indeterminates. Then the character xu of each element we F can be iden- 
tified with a unique element of the quotient ring TA. the coset consisting 
of all polynomials Pef which satisfy the right side of (3). Any automor- 
phism a of F_ induces in a natural way a permutation xu — xa(u) of the 
characters of F_ and, consequently, an automorphism on the ring generated 
by the characters together with the integer constants. Since the equivalence 
class ix; i a iy) of each indeterminate is identified with a character (4), 
it follows that the ring generated by the characters of F, together with the 
integer constants is identified with the entire quotient ring PA, The in- 
duced automorphism of F corresponding to a can consequently be regarded 
as an automorphism on the quotient ring A given by 


(16) i 


where the right side of (16) denotes the polynomial equivalence class in oA. 
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identified with the character. Let A, denote the group of automorphisms of 
the free group F,. Let |, denote the subgroup of inner automorphisms, and 
let J = A,/I, denote the quotient group of outer automorphism classes of 


F . It is readily verified that the induced automorphisms of F,, form a group 


a. and that the mapping which associates to each automorphism of F_ its 
corresponding induced automorphism on PA, is a homomorphism from A, to 


qd. The kernel of this homomorphism is the group of all automorphisms in A), 


which induce the identity automorphism. These are precisely the automorphisms 
of F which leave the characters invariant. This gives us the following re- 
sult. 


Corollary 1. If n > 3, the groups a. and J, are isomorphic. 


Corollary 1 raises the possibility that the induced automorphisms could 
be used to study the structure of the group J, 7 > 3. Results on the struc- 
ture of the ideals 4 for n= 1, 2, 3, 4 are given in [2] and [5]. 


5. The structure of q,. The ideal $, is the zero ideal [2]. Thus the 
character yu of each u € F, is given by a unique polynomial in fe Let 4, 
b be the two generators of F,. We set x= x, = Xa, y=%,= Xb, Z2=%),= 
xab. Then 7. = Zlx, y, z] the commutative ring of polynomials with integer 
coefficients in x, y, Z- The automorphisms 


a—ab 


(17) 
b—b 


together with the inner automorphisms generate A,. (See e.g. [4, $4.5].) Con- 
sequently the induced automorphisms of (17) given by the right-hand column 
of (18) below constitute a generating set for q.. 
(i) a—a-! 
b yoy 
(ab +a-'b) z—o4xy-2z 
(ii) a—t x—y 
(ab — ba) 
(iii) a—al 
yay 


(ab — a) zx. 


(To see (18Xi) we observe that ya~ 1p = = xbxa xba = xy — z by 
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(2).) The following theorem essentially characterizes a, as a subgroup of 
the group of automorphisms of Z[x, y, z]. 


Theorem 2. Let a be the group of automorphisms of the ring Zlx, y, z] 
which keep invariant the polynomial 


(19) C(x, y, z) = x2 + 4 2? xyz. 


Then the automorphisms of a, together with the two automorphisms 
(20) 


generate the automorphisms of @. 


Remarks. The automorphisms (20) are not induced automorphisms be- 
cause —x, ~y, —-zZ cannot be characters. For under the representation which 
maps every element of F, onto the identity matrix of SL, we must have 
xu = 2 for all wéF,. Thus xu #~-xv for all u, v € F,. The polynomial 
(19) has the following significance. The relation 


(21) = x? + y?2 4 227 -xyz-2 


(1, p- 337, formula (8)] can be verified directly by matrix considerations or 
derived by applying formulas (1), (2). Since every automorphism in A, maps 
the commutator aba~'b~! onto a conjugate of itself or its inverse, it follows 
that every induced automorphism must leave (21) and therefore (19) invariant. 

Proof. Let wy be the group of automorphisms of Z[x, y, z] generat- 
ed by a, together with the automorphisms (20). Clearly a>* < a>. To 


complete the proof we must show a = q.. Let 


(22) x—P, z—-R 


be an arbitrary automorphism in as where P, Q, R are polynomials in 
ZIx, y, z]. We wish to show that (22) lies in a”. We can suppose without 
loss of generality that the degrees of P, Q, R are in ascending order 


(23) deg P <deg O<deg R. 


For we see by (18)(ii), (iii) that the entire symmetric group on x, y, z is con- 
tained in é.. Therefore we can apply a permutation to (22) to obtain an auto- 
morphism with degrees in ascending order. If this automorphism can be shown 


to be in @}*, it will then follow that the original automorphism (22) lay in 
Let 
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P, #0, 


p-l 
Qo 0, #0, 


R, #0, 


where P,, Q,, R, are homogeneous polynomials of degree k (ise. P, is the 
sum of all the terms of degree & in P; similarly for Q,, R,). If one of the 
polynomials P, Q, R consisted merely of a constant term, then (22) could 
not be composed with any mapping to produce the identity, and hence could 
not be an automorphism. Thus we must have p, 9, r> 1 in (24). Since (22) 
keeps invariant the polynomial (19) we have 


(25) ~POR + P? + 0? +R? =-xyz+ x74 2%. 


Suppose first that p= q=r=1 in (24). If we then compare highest terms on 
the left and right of (25), we obtain P,Q,R, = xyz. Since x, y, z are irre- 
ducible, unique factorization implies that one of the polynomials P,, Q,, R, 
is tx, one is ty, and one is tz. We can suppose without loss of generality 
by composing (22) with a permutation as before that 


(26) Pi=c Q,=c.y R 


where ¢,, Cy C= +1 and €1C5¢3 = 1. If we substitute (26) in (24) and ex- 
pand (25), we see that the term c,c,P,yz appears on the left while there is 
no term in yz on the right of (25). Therefore P, = 0. Similarly Qo, Ry = 0. 
Now the four possibilities for (22) are 

(27) yoy yy yory 


z—> z—-Zz z—zZ. 


All of these are elements of @3* since they are all generated by the auto- 
morphisms (20), Now we proceed by induction on the maximum of the degrees 
of P, Q and R in (24). We may assume without loss of generality that p < 

q <r so that this maximum is r. If we expand terms on the left side of (25) 
using (24), we obtain 


-P,Q,R, + Pr Rot 


(28) 


=—xyz+ x74 27, 


where the dots represent terms of lower order. Since the situation p=q=r= 
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1 has already been considered we may assume r> 1. Then the term ~P,O,R, 
in (28) is of degree at least 4, Since the right side of (28) has highest degree 
3, it follows that all the terms of degree greater that 3 on the left side of (28) 
must cancel to zero. Thus there is no single term of highest degree on the 
left side of (28). We claim that r= p+q. For r>p+q implies that 2r > 2p, 
2r > 2q, 27 > p + 9 +7, and then R? of degree 2r would be the highest term 
on the left side of (28) and the only term with this degree. Similarly r < p + 

q implies that + > 2r > 2p, 2q, and then of degree p+q+r 
would be the highest term on the left side of (28) and the only term with this 
degree, again leading to a contradiction. If r = p + q, then the terms of high- 
est degree on the left side of (28) are -P,Q,R, + R? = 0. Therefore 


(29) R, = P,0,, 


Now consider the mapping 
(30) x— P, y—9Q, z—PQO-R. 


This mapping lies in a? since it is the composition of (22) with (18)(i). How- 
ever (30) has highest degree less than r as deg P= p<r, deg Q=q<r 

since r= p+q, and deg PQ—R <r since the highest terms P,Q, R, can- 
cel because of (29). Therefore (30) lies in @3* by the induction hypothesis. 
Now since (18)(i) is in e” it follows that the automorphism in (22) belongs 
to _ which completes the induction. 


6. Remarks on a, and G,. Unsolved problems. The question of the ex- 
istence of analogous results to Theorem 2 for any of the groups a, where 
n > 3 remains open. We have shown in [2] that the ideal , is a principal 
ideal generated by a polynomial of degree 4. One can readily obtain a gener- 
ating set for the group qd, by following the same procedure used for q,. The 
induced automorphisms on PA, thus obtained which generate a, are in 
turn seen to correspond to a set of automorphisms of ?, which leave the poly- 
nomial generating 4, invariant. In a communication to the author, Wilhelm 
Magnus has conjectured that an analogous result to Theorem 2 might be ob- 
tained for the group @ 3 using the polynomial generator of $, as an invariant. 
The precise relationship between the automorphisms of @ 3 and the automor- 
phisms of ,, which leave the ideal §, invariant awaits further investigation. 
Whittemore in [5] has given partial results on the structure of § 4 and has 
given a set of polynomials which collectively remain invariant under the auto- 
morphisms of @ 4° These results appear to indicate that the structure of q, 
increases in complexity as 7 increases. 
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ABSTRACT. In this paper, we prove certain one-sided Paley-type ine- 
qualities and use them to study the convergence rates for the tail probabili- 
ties of sample sums. We then apply our results to find the limiting moments 
and the limiting distribution of the last time and the largest excess of bound- 
ary crossings for the sample sums, generalizing the results previously ob- 
tained by Robbins, Siegmund and Wendel. Certain one-sided limit theorems 
for delayed sums are also obtained and are applied to study the convergence 
rates of tail probabilities. 


1. Introduction. Let be i.i.d. random variables, and let 
=X, If EX, =0, then for any €>0, | > en] 
converges to 0 as n — oo. The rate at which the above convergence takes 
place, and more generally, the rate of convergence for P[|s | > en*], a>1/2, 
have been studied by a number of authors. In [1], Baum and Katz have proved 
that for any p > 1/a, a>1/2, the following statements are equivalent: 


(1.1) Pils | >«en*]<oo forall «>0, 


k>n 


(1.3) E|X,|? <0, and for the case a<1, EX, =0. 


The analogous situation corresponding to the limiting case a=1/2 has been 
considered in [11], where it is proved that, for any p > 2, the following state- 
ments are equivalent: 
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(1.4) E|X ,|*(log*|X,| + 1)7?/2 <0 and EX, =0, 


(1.5) > | > e(n log <0 for all large 


(1.6) log > <co for all large 


It is natural to ask whether there are corresponding one-sided analogues 
of the above results. For example, if 1/2 < a<1 and Xx, X,, eee are i.i.d. 
random variables with = 0 and E(x)? for some p> 1/a, then is 
it always true that “P[S_ > en*] <co for all > 0? The answer to this 
question turns out to be negative, as will be shown in $2 by a counterexam- 
ple. However, if we also assume that EX . <oo, then the answer becomes af- 
firmative. In fact, the following result has been established in [2]. Let 
E|X ,|" <0 for some 1<r< 2, E(x})? <oo for some p>r and EX, = 0. If 
ar> 1, then 


(1.7) max <= for all 0. 

The additional requirement E|X ,|” <co is a natural assumption, for without 
it, P[S, > «n*] may even converge to 1 under EX, = 0 and E(X7)? <0 for 
all p, as our counterexample shows. In $3, we shall obtain a sharper version 
of (1.7). A corresponding one-sided analogue of (1.5) and (1.6) under the as- 
sumption EX, = 0, EX? <0 and E(X])*(log(2 + X]))~?/? < eo will also be 
given in $4. 

The series considered in (1.7) is closely related to the moments of the 
last time and of the largest excess of certain boundary crossings for the se- 
quence X_ and for the sequence of partial sums S_. More specifically, let 
us define 


Te, a) =supin>1:S,>en*} (sup d= 0), 


Me, a) = sup (S_- en"), 


n>0 


T, a) =sup{z>1: x2 en*}, 


M,(e, a) = sup(X -en*). 
n>0 
In $5, we shall consider the relations between the series in (1.7) and 
E(T(c, E(T E(M(e, and E(M a)) 
Our results here extend those found in [3], [8], [9] and [15]. 


(1.8) = 
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In $3, to sharpen the relation (1.7), we shall prove the following inequality: 
If Ex, = 0 and EX? <oo, then for a> 1/2 and p> I/a, 


(1.9) > max S,> <C, JEUXT + 
n=1 l<k<n 


where C,,a is a universal constant depending only on p and a. In fact, we 
shall derive a slightly more general inequality where we consider E|X,|" in 
place of Ex? for some 1<r< 2. The inequality (1.9) has some interesting 

applications in connection with the last time T(e, a) and the largest excess 
M(e, &) of boundary crossings. In $6, we shall show that as €|0, 


(1.10) 2. T*(a), 
where ‘t_2_3’ denotes convergence in distribution, and 


T*(a) = sup{t>0: W(t)>2%},  M*(a) = sup (W(e) - 
and W(t), t> 0, is the standard Wiener process. Using the inequality (1.9), 
we easily obtain that if E(x)? <oo for some p> 2, then 


(1.12) lim = E(T*(a))e2-!, 


(1.13) 
The inequality (1.9) enables us to simplify the proof and extend the result of 
Robbins, Siegmund and Wendel [15] and Kao [8] who in connection with cer- 
tain statistical applications have considered the limiting relations (1.10), 
(1.11), (1.12) and (1.13) in the case a = 1. 

The one-sided inequality (1.9) obviously implies the corresponding two- 
sided result: If EX, = 0, EX? <0o, a> 1/2 and p> 2, then 


co 
(1.14) max |S,| > $C, + 


n=1 
The above upper bound is sharp in the sense that a corresponding lower 
bound also holds: 


(pa-1)/(2a=1) 
(1.15) 1+ | + (Exper 

n=l 
We shall refer to the inequalities (1.14) and (1.15) as Paley-type inequalities 
because of their resemblance to Paley’s theorem which connects the type of 
integrability of a function with the rate of convergence of its Fourier coeffi- 
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cients (cf. [17, Vol. 2, p. 121]). The proof of (1.15) together with other re- 
lated results and applications will be presented in another paper. 


2. A counterexample. Let 0 <5 < 2 and define (x) = \x|~ 


for x <—c, and let a, b, c be positive numbers such that c >e and 


W(x)dx +b =1, a +b =0. 


Suppose X,, ++. are i.i.d. random variables with P[X, = 1]=6 and 
P[X, <x] =a Wx) dx for x<-c. Then EX, =0 and E(X7)? <0 for all 
Let x’ = 
that 


(2.1) P[x xt i.o.] = 0, 


>—n(log 8/2]? It is easy to see 


(2.2) ES’ ~(a/8)n(log as n—0, 
(2.3) ofS!) = (war ~ (a/2)'/? nllog n)~1/2-38/4 as 


Since 5 < 1/2 + 35/4, it follows from (2.2) and (2.3) that a(S") = of ES’). 
Therefore using the Tchebychev inequality, it is easy to see that S' /ES') 
—+ 1. This, together with (2.1), in turn implies that 


(2.4) (8/a)S_(log n)®/n +1. 


Hence lim, _.. Pls, >en*] = 1 for any 1> a> 1/2, and so in contrast with 
(1.1), = n~'P[S_ > en*] =. It is interesting to note that in the case a = 1, 
> en] for all > 0 by Spitzer’s theorem [16]. 

We remark that our counterexample also gives a negative answer to the 
following question. The Marcinkiewicz-Zygmund strong law of large numbers 
states that if X,,X,,... are i.i.d. with EX, =0 and E|X,|? for some 
1< p< 2, then n-1/bs — 0 a.e. It is natural to ask whether the one-sided 
analogue, i.e., lim sup, 0 a.e., would hold if EX, = 0 and 
E(x)? <oo, We note that this fails to hold in our example, since (2.4) im- 
plies that 


(2.5) lim sup (8/a)S (log n)®/n>1 ae. 


3. A one-sided Paley-type inequality and its application to the conver- 
gence rate of tail probabilities. Let X,,X,, ++. be a sequence of random 


variables. Henceforth we shall use the following notation: For any real num- 
bers t, r> 1, 
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We first prove an inequality of which (1.9) is a special case. 


Theorem l. Suppose X,,X,,... are i.i.d. with EX, =0 and E|X,|"<eo 
for some 1<r< 2. Let a> 1/r and p>1/a. Then there exists a universal 
constant C, ,, > 0 depending only on p,a and r such that 


Proof. Let k be the smallest positive integer > (pa — 1)/(ra - 1). We 
note that 


PIS PIX, > n°/(2k)] + PIS, > n°, < n°/(2k)) 
.2 
< nP[X, > 2°/(2k)] + P{s >n*,X <n°/(2k)). 


For each fixed n, define 


re inf > 1: > n*/(2k)}, 


r, = 7% = inf{j > 1: 44751, 27 ete. 


Without loss of generality, we can assume that E|X,| 4 0.Since EX, = 0, it 
follows from the Chung-Fuchs theorem that P(r, <co] = 1. Also Tis Toy ee 
are i.i.d. random variables. Hence 


(3.3) 
< Pr, <n] = PAS, > 


Now there exist positive constant A, and B, depending only on r such that 


PIS, > n°/(2k)] < A |” (cf. [4, p. 317) 


< B I". 


The last inequality above follows from the Marcinkiewicz-Zygmund inequali- 
ties (cf. [13]). Letting A= k -(pa -— 2)/(ra — 1), we have A> 1/(ra — 1) 
and it follows from (3.4) that if E|X,|”> 1, then 
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> > n*/(2k)] AEIX, > n7Mra=1) 
|" 


Ix | r)(pa-1)/ (ra-1)_ 


Also obviously 


(3.6) 


< Nya EIX r)(ba=1)/ (ra=1), 


(3.7) PIX, > 0, 


n=1 


Using (3.2), (3.3), (3.5), (3.6) and (3.7), we then obtain the desired conclu- 
sion for the case E|X,|”> 1. 
If E|X,|" <1, then it follows from (3.4) that 


(3.8) n=1 


< Pp EIX 


Hence the desired conclusion also follows in this case. 


Corollary. Suppose X,,X,,... are isi.d., EX, =0 and E|X,|" <0 for 
some 1<r<2. Let a> 1/r and p> 1/a. Then (1.7) is equivalent to each 
of the following statements: 


(3.9) E(X7)? <0. 


(3.10) sup k~°S, > <oo forall 


k>n 


(3.11) >en*]<0 for some «>0. 


Proof. Replacing X, by X,/e in Theorem 1, it is easy to see from Theo- 
rem 1 that (3.9) =» (1.7). By Lemma 2 in $5 below, (1.7) =» (3.10). Obviously 
(3.10) =» (3.11). By an argument due to Erdés [5] (see also Lemma 3 below) 
we can prove that (3.11) = (3.9). 
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The results in the above corollary have been partly established in[2] by 
different methods. In[2], the case a = 1/r and p>r for 1<r< 2 have also 
been considered and it is proved that in this case, (3.9) still implies (1.7). 
The following one-sided theorem on the convergence rate of tail probabilities 
deals with the case a> 1. In this case, when oP > 1, it anene immediate- 
ly from Theorem 3 of [1] and the fact that SS i treet x* while the situ- 
ation ap = 1 can be proved by using These 1 Gi) and Leone 3 of [2]. 


Theorem 2. Suppose X,, X,,... are iid., A > 1 and ap> 1. If 
E(xT)? <oo, then (1.7) holds, and consequently (3.10) also holds when ap>1. 


We remark that in Theorem 2, the relation (1.7) does not necessarily im- 
ply E(x7)? <oo, To give an example, let 0< p< 1, a> 1/p, y> 
Setting q = pa/{Apa— 1)}, we have 0< q<p. Choose 0<v<1 such that 
y <{AXpa 1)}7. Let X,,X , +++ be i.id. random variables such that 
< 00, E(xt)? =co and has the stable distribution with exponent v, i.e., 
the Laplace transform of Xj is given by E exp(-AX7) = exp(-A”), A> 0. 
Since E(X pe < oo, it follows from the Marcinkiewicz-Zygmund strong law of 
large numbers that 


(3.12) lim max(X} +++++X7)=0 a.e. 
n—+00 j<n 


In particular, (3.12) holds along the subsequence [mee/(pa-D , 
and so 

lim max (Xt Xt) =0 ace. 
(3.13) jemb2/ /(Pa-D j 


This in turn implies that 


im 
(3.14) Lim pal (pa-1) 9 


has the same distribution as X7, ond} it is all known that P[XT < ¢] = 
Aexp(-t~”)) as t]0. Since y < {r(pa it follows from the Borel- 
Cantelli lemma that 


¥5(~) 


From (3.14) and (3.15), we obtain 


im 


Since a/(pa — 1) < y, (3.16) implies that 


-a/(pa-le 
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By Lemma 3 of [2], (3.17) is equivalent to (1.7). We remark that the above ex- 
ample is similar to the one given by Baum [18] in another context. 
Thus we have seen that in Theorem 2, (1.7) does not necessarily imply 

E(X ls <oo, A sufficient condition which would guarantee this implication is 
E|x,| 1/2 < 6, Under this additional condition, lim nP[X, > en*] = 0, and 
by the Marcinkiewicz-Zygmund strong law of large numbers, >en*] 
= 0. Hence it can then be shown by the Erdés method that, in this case, (1.7) 
implies E(x7)? < 0, 


4. One-sided limit theorems for delayed sums and their relation to the 
convergence rate of tail probabilities. The quantity 5, , defined in (3.1) is 
called a delayed sum for the sequence X_ (cf.[17, Vol. 1, p. 80]). In[2I, the 
following strong law for delayed sums has been proved: If X,,X,,... are 
iid. with EX, =0 and E|X,|? <0 for some p> 1, then for every 0< B< 
min(1, 2/p), 


li max |S_ |= 
(4.1) IS,,j)=0 ae 
The corresponding one-sided limit theorem has also been obtained: If E|X,|’ 
<oo for some 1<r< 2, E(x})? <oo for some p>r and EX, = 0, then for 
every 0< 8B <r/p (or for every 0< B< 1/p in the case r= 1), 
(4.2) lim sup ae. 
n,n 

For Gr> 1, obviously (4.2) implies (3.17) which is in turn equivalent to (1.7). 
Thus based on the equivalence between (1.7) and (3.17) which holds for any 
a@>0O and ap> 1, we can prove theorems concerning the convergence rate of 
tail probabilities from the corresponding limit theorems for delayed. sums. 

We note that while B ranges from 0 to min(1, 2/p) in (4.1), the range of 
B in (4.2) is from 0 to r/p. Our example in $2 shows that we cannot extend 
the range of B in (4.2). In that example, r= 1 and we can take any p> 1 
since xT is bounded. Now for any 0< B< 1, since s n6 has the same dis- 
tribution as A B» it is easy to see from (2.4) that 


(4.3) lim sup(5/a)S_ log n)®/n®§ >1 ae. 


n,n 


Therefore if B > 1/p, then lim sup, a.e. This shows 
that we cannot extend the range of B in (4.2) beyond r/p. It is interesting 
to note that in spite of (2.4), we have for any 0< B < 1, 


(4.4) liminfS (log n)°/n® =-c0 
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To prove (4.4), let =(X 4+ X (log n)/nF, Y, = X (log 
Suppose (4.4) is not true. Then by the zero-one law, there exists a constant 


c such that lim inf, (Y,+Z,)>c a.e. Since Z, is independent of 


(Y,, and Z it follows from 1 in[ 11] that 


lim Y,2¢- (a/8) a.e. But lim inf, Y,=- since EX (log|X, 1)? 
= —co,and so we have a contradiction. 

The proof of the equivalence of (1.4), (1.5) and (1.6) in[11] is based on 
the following analogue of the law of the iterated logarithm for delayed sums: 


If X,,X5,... are iid. and <1, then 


 EX?=07 and EJX,|?/A(log* |x,| + 71/8 < 


(4.5) 
= lim sup max |S, B)n® log ni!/2 ace. 


Theorem 3 below gives the one-sided analogue of (4.5). 


Theorem 3. Let X,, X,,... be i.i.d. random variables such that EX, =0, 
EX? = 07(<0o), Then 0 < <1, the following statements are 


(4.6) Stx oe X2/B (log dP <0, 


(4.7) lim sup — log <g 


n—oo 


(4.8) lim supS B)n® log n}!/2 <0 ae. 
n,n 


Lemma 1. Let X be a nonnegative random variable such that Eg(X) < 0 
for some nonnegative Borel function g. Then there exists a positive nonde- 
creasing function on [0, 0) such that lim,_,,, W(t) = ©, lim, U(t?)/wt) 
= 1 forall p> 0 and Ey(X)g(X) < 


Proof. Let F be the distribution function of X. Let (n wk>1 be a se- 
quence of integers such that n, > 2, n,,, > 2”* and | al g(t) dF(t) < 27*. 
Let = 0 and define wz) = for . Wt) To as 
t Too and 


n oo 
= J, p(t) dF(t) + pi/22-(k-D 
k=2 


| 
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Proof of Theorem 3. First suppose that (4.6) holds. To prove (4.7), we 
shall use the idea of Hartman and Wintner [7] in truncating the random vari- 
ables from below. By Lemma 1, we can choose a positive nondecreasing func- 
tion on [0, such that lim,_.,. W(t) = lim, = 1 for all 
p>O and EX*(|X,|) < co, Without loss of generality, we can assume that 
o>0. Given 5> 0, we pick an integer k > 1 such that k~ Bk> 1 and then 
choose ¢ > 0 such that ek <5. Define 


ays 1/2 1/2 B/2 


7 


xBox I 


I 
n n [x ren n)'/2] 


Let U, = EX"), Then EU, = 0, EU2 =07 and 
< 2n®/{(log + (log 1/7} = Y,= o(n®/2(1og n)~ 1/2), 
Hence for ltly; 
exp{t?o%(1 ~ |t| y)/2) E exp(tU,) < exp{t7o%(1 + Altly)/2 
(cf. [12, p. 255]). Therefore by Theorem 1 of [11I, 


(4.9) lim sup +U, - B)n® log n}!/2=0 ae. 


We note that, since EX, = 0, we have for all large 2, 


xX aP| 


/B /B- 2/ -1/ 


Therefore 


(4.10) lim | log nj!/2 0, 


n+j 
fal 
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It is obvious that 


(4.11) lim sup max (X02) 4 x) log n}!/2 <0 


(4.12) lim max (X‘4) 4 log ae. 


Since 0< xe? < en®/(log n)'/2, it can be shown as in the proof of Theorem 
2 in [11] that 


P| max 2 (nF log 


l<j<n 


< > (log n) 1/2} 
j=1 


= O(n log n)>/P/n}*), 
Since k- Bk> 1, an application of the Borel-Cantelli lemma gives 
(4.13) lim sup max x@) log n}!/2<8 ae. 
1Sjsn 
As 5 is arbitrary, we obtain (4.7) from (4.9), (4.10), (4.11), (4.12) and (4.13). 
Obviously (4.7) implies (4.8). Now assume (4.8). By the zero-one law, 


there exists a finite constant c such that the lim sup in (4.8) is <c a.e. 
Define 


Y, =X B)n® log n}!/?, 


n 


Since EX, = 9 and Ex? =o, 0. Obviously is independent of 
(Y,,.--, Since lim sup, a.e., we obtain using Lemma 
1 of [11] that lim sup 
By using a similar argument as the proof in[11] of the equivalence of 
(1.4), (1.5) and (1.6), we can obtain from Theorem 3 the following one-sided 


n-co Yn %€. From this, (4.6) follows easily. 


theorem on the tail distribution of sample sums. 


Theorem 4. Suppose X,,X,,... are EX, = 0, EX} =07(<~), 


Then for any p> 2, the following statements are equivalent: 


~p/2 
(4.14) X®(log X ,)~ 2/2 dP < 00, 


(4.15) PLS > log n)!/?] <0 for all «> o(p 2)'/2, 
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(4.19) /2-2P| log ( forall e>olp- 


k>n 


(4.17) > €(n log n)'/2| for some «> 0. 


5. Applications to the moments of the largest excess and the last time 
of boundary crossings. In this section, we shall consider moments of the last 
time Te, a) and of the largest excess M(e, a) of certain boundary crossings 
for the sample sums S| as defined in $1. These are related to the moments 
of T ,(c, a), M,(e, 2) for the original sample observations X_,- We now intro- 
duce the following notation: For p>0,a>0, 


(5.1) p, a) = f° > dt, 


(5.2) Ke; p, a) = sup S, > at, 


k>t 
(5.3) mle; p, a) = E(M(c, M(e, a) = sup (S_ en”), 


n20 


(5.4) re; a) = E(Tle, Tle, a) = supin> 1:5 > (sup ta 0), 
(5.5) p,a) = 


(5.6) J le; p, a) = f > ef* dt, 


(5.7) I,e; p, a) = sup k~*X, > | at, 


k>t 


(5.8) m,(e; p, a) = E(M, le, a) = sup (X, - en"), 


n20 
(5.9) r le; p, a) = E(T T ,(c, a) = sup{n> 1: 


(5.10) s le; p, a) = 


Lemma 2. Let S,,5,,.+.+. be any sequence of random variables (not nec- 
essarily sample sums), Define = S$, =0,S,= = Sj» and de- 
fine Jle; p, a), Ile; p, a), mle; p, a), rle; p, a) and se; p,a) as in (5.1)-(5.5). 
Then, for any positive constants ¢, p,a with pa> 1, 

(pa 2; p, a) < mle; p, a) 
(5.11) 
< _ J(¢/2; p, a), 


(5.12) r(e; p, a) < (pa — (e; p, a), 
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(5.13) a) < sle; p, a) < K, p, a) + mle; p, a)}, 
where K,,=1 if pa-~1¢a and K, , = if pa —1> a, 


Proof. Let r =(pa — 1)/a. We note that 


p, a) = P[ sup s, -en’)> dt 


k-1,, 1/ 
LS 2 2 


To complete the proof of (5.11), we have 


1(2e; p, a) = sup k~°S, > 2] dt 
>t 


ig sup (5, en) > a) a = (pa 1)-1E(M(e, 

Since P[T(c, a) > t] < Plsup,,, k~°S, >], it is easy to see (5.12). Finally, 

(5.13) follows immediately from the fact that 


(5.14) eT “(e, a) < Sree a) 2) + sup(S, - en*). 
We remark that if x, ; X,, -++ are i.i.d. random variables with EX, =0 and 


(S_) is the sequence of partial sums, then Lemma 2 and inequality (1.9) im- 
ply that for a > 1/2, p> 1/2 and «> 0, 


(5.15) mle; p,a) < A, */e)? + (E(X 


where A, , > 0 is a universal constant depending only on p anda. In the 
case p= 2 and a= this reduces to E(sup, ,(S,, -en))< a re- 
sult obtained by Kingman [10] by a different approach. In fact, Kingman 
showed that the constant A in the above upper bound can be taken to be 1/2. 
This is a very sharp bound for small € in view of the fact that 


2 
lim (sur(s, - cn)) = 
n20 


(see Theorem 7 below). 
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Lemma 3. Suppose a > 1/2 and X,,X,,... are i.i.d. random variables 
with E\X,| 1/4 < 45, Assume further that EX, = 0 in the case a<¢ 1. Letting 
we have for any y>0,¢€>0, 


E(T(€,a))” < co = E(T ,(2e,a))” < 0. 


Proof. Set A, =[X, > 2k“], B, =[|S,_,| < By the Marcinkiewicz- 
Zygmund strong law of large numbers, n a~*S — 0 a.e., and so lim, _,, P(B, 
= 1. Since E|X, lim, so A )= = P(A, i.o.) = 0, and so we 
can choose my such that P(B,) - PU®.,. A) >¥% if k>m> mp. By an ar- 
gument due to Erdés [5], we then obtain that, for m > Mos 


P[T(c, a) > m] > > U 


k=m 


1 1 
25 P(A,) > 5 PIT a) > ml. 
The desired conclusion then follows. 


Lemma 4. Suppose X,,X,,... are i.i.d. random variables and a> 0, 
p> 1/a. Then forall «> 0, 


(pa— 1)J p,a) and pal, le; p,a)< 
Furthermore, if J ,(€; p, <0 for some €>0, then E(XT)? < co and 


Proof. We note that 


p, a) = (pa—1) > tl dt 


= (pa-1) > 2-“en® for some n > 


t<n<2t 


> (pa~1) max 


> (pa-1) > 


It is also easy to see that 


pa] ,(e; p,a) = pa 19-2 PIX > Ide 
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To prove (5.16), for any c > 0, define X (c) =X, i[x, ec}? X fc) = 
max,<.<, X fe), = Xp(c) = 0. Put n= and note that 


PIX (c) > t*] = PLX,(c) > + PIX (c) > t*IPIX < #7] 
+ _j(c) <2 +++ PIX (c) < 27] 
> nP[X > (c) 


= nPIX ,(c) > PIX, > 
Therefore, for ¢ > 1, 


(c) > t*) < nPIX (c) > #7] < PIX c) > + nPLX 


< PIX (c) (c))!/4 }, by the Markov inequality. 
From this, it follows that 
E(X*(c))® ~1< pa (c) > dt 
(5.17) 


Suppose E(x} )? =o. Then = o( (c))*) as c and so 
it easily from (5.17) that J,Q; p,a) =. Hence im- 
plies that E(X})? <o, and in this case, letting c J in (5.17), we obtain 
(5.16). 

Lemmas 2, 3 and 4 together with the results in $3 give the following 


theorem. 


Theorem 5. Suppose X,,X. ,... are random variables, S, =X, + 
soe +X, and a>0, p>O such that ap> 1. 

(i) If E(x} )? <0, then for every €> 0, 1,(€; p, a), J p, 2), 

m {e; p,a), 7,(€; p,a) and s,(e; p,a) are all finite. Conversely, if one of the 
above five quantities is finite for some «> 0, then E(x; )? < 00, 

(ii) Suppose E(x})? and a>. In the case a= 1, assume fur- 
ther that EX, = 0. In the case a <1, assume further that EX, = 0 and 
E|X ,|’ < for some 2>1r>1/a. Under these assumptions, I(€; p, a), 

] (6; mle; p, a), p,a) and s(e; p,a) are finite for all «> 0. 

(iii) Suppose a >% and E|x,|!/° <0o. Assume further that EX, =0 
in the case a< 1. If one of J(e; p,a), J (e; p, a), mle; p, a), tle; p,a) and 
p,a) is finite for some «> 0, then E(X})? < 


Y. S. CHOW AND T. L. LAI 


6. The limiting distribution and limiting moments of the last time and 
largest excess of boundary crossings for sample sums. The following theorem 
gives the limiting distribution of T(c,a), M(e,a) and a) as 0. 


Theorem 6. Suppose W(t), t > 0, is the standard Wiener process and Xi, 
X,, are i.i.d. random variables with EX, =0, EX} = 1. Let =X,+ 
+X ,a>4%, and define M(e,a) and T(e,a) for any €>0 by (5.3) and 
(5.4). Let M*(a) = sup,,9 (W(t) - T*(a) = sup{e > 0: W(t) > 2°}. Then 
as 


(6.1) 2. T*(a), 
(6.2) g) u*(a), 


1/(2a=1 D 


Proof. (6.1) and (6.2) can be proved by an argument similar to that of 
Robbins, Siegmund and Wendel [15] or that of Miller, [19], who considered 
the problem in the case 2 = 1. Alternatively we can use a result of Robbins 
and Siegmund [14, Theorem 2] in the following way. For any x > 0, 


Ple2/(2a-D7(¢, a)> x] 


= P{s >en® for some n > 


> Vmln/m)* for some n>xml, where m = 


— P[W(t)>+t* for some t>x] as 


Similarly, given any x > 0, if we apply part (ii) of Theorem 2 in [14], where 
we set g(t)=1° +x, then 


a) > x] = sup(S - Vm(n/m)*) > 


n>1 
where m= 
= Plm= 1/25 >(n/m)* +x for some n> 1) 
— P[W(t) > for some t>0] as m— 
To prove (6.3), we note that gy €(T(e, a) + andso 


(6.4) fe2/ T(e, a) + /(2a-Dy T(€,a) +1 
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Since EX? < co implies that n~ — 0 a.e., it follows that 


(Tle, a))~ 


T(€,a)41 


By (6.1), (T*(a))!/2. Therefore 


1/(2a-1 P 
(6.5) 


From (6.1), (6.4) and (6.5), it is easy to see that (6.3) holds. 
By making use of the inequality (1.9), we now obtain from Theorem 6 the 
limiting moments of T(e,a), M(e,a) and Sriea) as € 0. 


Theorem 7. With the same notations and assumptions as in Theorem 6, 
if E(x})? < co for some p> 2, then for any a>, 


€ 


(pa-l)/a _ *())\pa-l 
tins ¢ = 


The above relations also hold for 2> p> 1/a. 


Proof. In view of Theorem 6, we need only show that (¢2/(2a-D7(¢, a) ban 
and (e!/(24-D(e, 1, are uniformly integrable, as this will 
in turn imply that ress. 0<€<1, is also uniformly in- 
tegrable by the inequality (5.14). First consider the case p > 2, Let 0<6 
<¥ and define 


where K > 0 is so chosen that 
(6.7) E((x4/5)*)? + <5. 


Let 
S, =X 


and define T'(c, a), M'(e, 2) for S’, T"(e, a) and M"(e, a) for 
Lemma 2 and (1.9), we obtain that for 0 << 1, 
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co 
<A €2(pa=1)/(2a=1) > max S" > 
; 
l<jén 


(6.8) 


Ss B, 0: noting that p < 2(pa — 1)/(2a - 1) since p > 2. 


The constants A, . and B, Wa above depend only on p and a. Now take any 


q >> and by a similar argument as in (6.8), we have 


S)e, 


{E((x‘)*)? + (E(x‘)”) (qam1)/(2a=1)} 


where C_ . is a positive constant depending only on q and a. Hence setting 
Z(c, 8) = (e2/(24-D7"((1 — 8)e,a))?!, we have the uniform integrability of 
Z(e, 5), O<€ <1, and so we can choose 7 >0 such that if P(A) <7, then 
EZ(e, 5)1, <6 for all O<€< 1. Since a) < T'((1 d)e, a) + T"(Se, a), we 
have established the uniform integrability of O<e 4. 
in the case p > 2. 

Now let 2> p> 1/a. Then by what we just proved, («?/(2¢-T(e, a)! 
is uniformly integrable, and so («2/(22-D7(¢, a)?! is also uniformly inte- 
grable. The desired conclusion for M(e,a) can be similarly proved. 

Theorem 7 gives the asymptotic behavior of 7(e; p,a) and mle; p,a) as 
¢ 10. It is also interesting to investigate the asymptotic behavior of J(e; p, a) 
and I(c; p,a). This is given in the following theorem. 


Theorem 8. With the same notations and assumptions as in Theorem 6, 
define J(e; p,a), Ke; p,a) by (5.1) and (5.2), and let ® denote the distribu- 
tion function of the standard normal distribution. If E(x)? <0o for some 


p> 2, then for any a>, 


€ 


6.10 
(6.10) = 2 lim (20-1) So > dt, 
0 


(6.11) lim(pa (¢, bs a) =< 


Proof. To prove (6.10), we note that by a change of variable, we can write 


| 
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Ife; p, a) 
(6.12) _ = 


> 2] gy, 


co = 
= pa-2 


ue~ 
By Donsker’s invariance principle, for any u > 0, 


PIs > 2] 
€10 2/(2a=1) = 


(6.13) 
Pf max W(t) > = 


It then follows from (6.12), (6.13) and Fatou’s lemma that 
(6.14) lim inf » a) 


To obtain the reverse inequality with lim inf replaced by lim sup, we 
let 0<8<1 and define by (6.6) with K > 0 so chosen that (6.7) is 
satisfied and 0<o<1+5, where = E(x')?. Let =X) 
SU =X and define J'(e; p,a) for S', J"(e; p,a) for Obviously 
Jf; p.a) < p, a) + J"(Se; p, a). Using the inequality (1.9) as in 
(6.8), we obtain that 


(6.15) < max (S*/(e)) > 


l<jgn 
< where and depend only on p and a, 
Choose B > 1 large enough that u* — (2u)* > 4u% for all u>B and 
2 _ du <8. 
Let ® =(1-5)</o. As in (6.12), we have 


(6.16) 


max (S! /a) > du. 


72/(2a=1) 


is 


= 
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By the dominated convergence theorem, 


| max /a) > du 


jeue72/ (20-1 


(6.17) fP max du (as 0) 
0 
0 


Using the Lévy inequality [12, p. 248], we obtain for u > B, 


max /o) > 


/(2a~1) 
(6.18) 


< 2P[s’ 


We now apply an estimate, due to Esseen [6], to the above probability: 
Let k be a positive integer such that k — 2> 2(pa — 1). Then there exist 
positive constants c,,c, depending on the absolute moments E|x}|?,E|X4)*, 
A E|x‘|* such that for all nm = 1, 2,--+ and all real x, 


2 
< - ®(x)| < (1+ * /? + 


(cf. [6, pp. 73-76]). Set n = for u>B. Then n>1 if & <1. 


Therefore applying the above estimate, we have for & <1 and u>B, 


(6.19) + + exp 


Since (k - 2)/2> pa-—1, it then follows from (6.19) that 


$2 (1 - du < 8, 


It then follows from (6.15), (6.16), (6.17), (6.18) and (6.20) that 


8 

€10 

(6.20) 
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lim sup (pa-D/(2a-1) 


Since o< 1+6 and 6 is arbitrary, we therefore have 


€ 


In a similar way, we can obtain the asymptotic behavior of 


as ¢ |0 given in (6.10). Finally, we note that 


P| up k~*S, > > PIT(c,a) >t] > pf sup k-*S, > | 
k2t k>t 


and so (6.11) follows immediately from Theorem 7. 
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JOHN B. JACOBS 


ABSTRACT. Two algebras of Block, 5, f) and f’), are 
isomorphic only if m(G) = m(G’). This is not sufficient for isomorphism. 


Let & be a simple finite-dimensional Lie algebra over ®, an algebrai- 
cally closed field of prime characteristic p. Simplicity allows the identifica- 
tion x «+ ad x for each x €&. (That £ be centerless is sufficient for the 
identification.) Then if D(L) denotes the derivation algebra of £ we have 
& (= ad 2) C DL). For each x € &, (ad x)? is a derivation of & and, if 
(ad £)e* is the vector space spanned by {(ad x)e*|x e&}, then RL) = ad & 
+ (ad £)? 4 (ad 4 isa subalgebra of )(£) which is restricted. We 
will call R(L) the restricted algebra of &. If & is restricted, then ad £ = 
R(L), or under the identification, 2 = R(L). Thus, for any arbitrary center- 
less algebra Lc RL) Dk). Clearly, any two isomorphic simple alge- 
bras & and £' over ® must have R(L) = RL") and D(L) = D(L'). We will 
use this relationship to determine isomorphism conditions upon the algebras 
of Block. 

Let G be an elementary abelian p-group written as a direct summand of 
elementary abelian p-groups, G=G,)®G, ® ® G_. Let be an alge- 
braically closed field of characteristic p > 3. For each i=0,1,..., m de- 
fine {: Gx G such that [,:G,;x is a skew-symmetric, 
nondegenerate biadditive form. Then f=/,+/,++*+++/,. Foreach i=1, 
«+s, m, assume that there exist additive functions &4;:G;- ® such that 
fa, B) = g fadb {B) - g (Bb fa). Pick 6,€G, for which g = 0, and set 
5=5,+-++++8_. Define L(G, 5, /) to be the Lie algebra over ® with basis 
{u,|a €G, a4 0, -5} where multiplication is given by 
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Here a, and B, denote the ith components of a and f, respectively, in G 
and 5, is assumed to be zero. L(G, 5, ) is then a simple algebra over ® 
called an algebra of Block. 

The derivations of the algebras of Block have been completely deter- 
mined in [1]. As they will be utilized later, a brief description follows. 

Since G is an elementary abelian p-group it is an n-dimensional vector 
space over %, (the prime subfield of ® = GF(p)), each of the G,’s being a 
subspace of dimension, say, Pick a basis } for G 
and {0,,,+++, for Gj, such that /(o,,,5,) = 
{ {o,,, 5) # 0. Such is possible since / is nondegenerate. For each a €G, 
write a=2, 2, s{a)d,. The coefficients s; (a), s Aa) of the 
and on since the and 6,’s form a di G. The der- 
ivations of £(G, 5, f) are linear combinations (over ®) of the elements in 
the following sets: 

(i) R ={ad u,,|a €G,a¥ 0} (ad u_s is included although not an ele- 

ment of £(G, 8, /)). 

(ii) = {D(o,;, -5,), -5,)|k =1,...,m} where u,D(y,, -5,) = 
Man for y, in G,. 

n,—1} where Gy # {0} and T = {D(5, 0), O)|é = 1, ms = 2, 
n;- 1} when Gy = {0}; where u,,D(a;-, 0) = and 


u,D(5, 0) = (-1 + 


(D(c,,, 0) is a linear combination of ad us. and the remaining D(a,., 0)’s.) 

The set S is, of course, empty when m = 0, The dimension of "RG, 5,/) 
is np” -1 for m=0 and np" —2 for m> 0, and it follows that the dimen- 
sion of its derivation algebra, D(L(G, 5, f)), is 

(i) np” +n-1 when G=G, or when G, 0 and m>0. 

(ii) np” +n when Gy = 0. 

From the dimensions of the derivation algebras and their derived alge- 
bras, Block concludes in [1, Theorem 14, Corollary 1] that necessary condi- 
tions for two algebras 2(G, 5, /) and £2(G', 5’, f') to be isomorphic are that 
either = 0, G,=0, and m(G) = m(G"); or #04 G and min{2, m(G)} 
= min{2, m(G‘)}. By considering the restricted algebra of £(G, 5, {) we will 
show that it is necessary that m(G) = m(G’) for isomorphism and that, indeed, 
this is not sufficient. 


For u,, ug e &(G, 5, {) it is easily shown by induction on m that 
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u, (ad {(a,, BY (a; B;) f(a, - (p 1)5 


The following lemma then shows that 
u(ad = {f(a,, B)? - f(a,, wy 


Lemma 1. Let a, be , char 9 =p >0. Then 
ala ba 2b) +++ (a — (p — 1)b) = a? 


Proof. The polynomial x? —xb?~! has roots ib for i=0,...,p-—1. 
Hence, x? (x ib). Substituting @ for x the desired 
result. 


It is evident that 


i=0 
and more generally that 


i=0 


n 
Suppose that a= 27_)a,=27 (22, +2; sy 


Then 


i=0 


m q; k kel 
i=0 \j 


m 


ad uf ¥ 


75 
or 
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where =m, and q,=n,-1 for i=1,...,m. The restricted algebra 
R(L(G, 5, f)) is therefore contained within the span of R UT. In the follow- 
ing discussion we will show that a basis for R(L(G, 5, /)) is RU T\fad u_s} 
when Gy # {0} and RU T\{ad w_s, D(S, 0)} when Gy = {0}. It follows that 
dim R(L(G, &, = dim L(G, 8, +2 2m. 

Definition. The column rank over %, of a matrix A with entries from ® 
is the dimension of the vector space over 2, spanned by the columns of A. 
Denote this dimension by col tank, | (A). 


Lemma 2. If G=Go, then col ranks ,)) =n, the dimension 
of G over ®,. 


Proof. Suppose col ranks, <n, that is, suppose that there 
exist elements @,,@,,+++,@,€ ®,, not all zero, such that 


a flog, =0 


for i=1,...,m. Then from the biadditivity of { we conclude that 
a =0, or = 0 for i=1,...,n. This 
contradicts the nondegeneracy of {, whence the lemma is proved. 


Lemma 3. Suppose G=G,. Let {B,,-+-»B,,5} be a basis for G where 
{(B,; 5) # 0, and let 


{(B,> - +++ {(B,» B,_:)- 1B,» 0 


Then col ranky (A) =k. 


Proof. Suppose col rankg, (A) < k. Then there exist a,,...,@, €®,, 
Dd 1 k p 
not all zero, such that 


k 


for i=1,...,k and a./(5, = 0. For each of the first k equalities 
we have 


=| 
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k k 


k p-1 


if # 0. Thus, foreach i=1,...,h, there exists c; such that 
{(B;, = a. jB; J=c,f(B;, 5) (if 5) = 0, then c,; = 0). define 
g:G iat G by g(a) = fla. 5) and = =/(B,, 
whence /(a, B) = g(a)A(B) 2(B)h(a). Now 


k k k 
j= j= j= 


But 2a. PACE B; )? =0, so a,B;-¢ = 0. This implies the contra- 
diction fla, ja1 4; -c,6)=0 he all a, implying that col rankg Ade k. 

is a basis of G over Equation (1) shows that 
5, (D(o;, 0), ad x| x e £(G, 5, and for the special case k=1 


we have a matrix equation of the form: 


q 4 0) 


Do, 1? 9) 


77 
or 
and 
d 
a 
ad u? Dio 0) 
ad 
m1 
0 Cc 
m 
ad ub Dio, -1? 0) 
™m m 
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where Cy = and, for i>0,C, isan n, x (n; -—1) matrix of the 
form of the matrix in Lemma 3. Denote this matrix by C. To determine the 
coefficient matrix of the D(o,,, 0)’s for higher powers of p, one merely 
raises the elements in C to the appropriate pth power. 


Lemma 4. Let A = (a; .) be an rx matrix over a field ® of character- 
istic p>0 and let A,, = ) for t> 0. If col rank =s, then 
ranks (A A, =s large t (7 denotes trans pose), 


Proof. Since A, (A - <s forall i 
there exists some ¢ such that (A - = If 
rank, (A <s, then there € ®, not all such 
that babe = 0 forall i, l<i<r, andall v,O<vu<t. Note that this, 
and the choice of t, implies eet ba piel = 0. Assume that the b’s have 


ij 
been chosen so that the number of ame b is minimal. In addition, assume 


=l1. Then 


+1 
On the other hand, since a bape =0 for O<v<t we have 


s 
= 
jul 


Extracting pth roots and using the minimality of the b’s (recall b, = 1) gives 
- =0 for all 7, that is, for all This contradicts the assump- 
tion that col rankg A =s. 
Returning to eC. recall that the nondegeneracy of { guarantees that 
col rank, Cy =m, and col rankg C,=n,-1 for i>0. Lemma 4 then allows 
Dp Dp 
us to conclude that 


(D(a,,, 0), ad x| x € L(G, 8, 8, 


Inclusion in the other direction was illustrated earlier, completing the proof 
of the main theorem. 


Theorem. Let £(G, 5, /) be a simple Lie algebra of Block. Then 
dim R(L(G, 5, f)) = dim L(G, 5, f) +n 2m. 


Corollary. Two algebras of Block of the same dimension, 2(G, 8, {) and 
£(G', {'), are isomorphic only if = m(G'). 


From the preceding discussion it is evident that for L(G, 8, f) and 


L(G', 5’, {') of the same dimension isomorphism is not guaranteed by the 


s 
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equality m(G) = m(G'). This follows from the fact that R(L(G, 5, f)) need 
not be isomorphic to R(L(G', 5’, f")). For example, let m(G) = m(G’) = 0 and 
Suppose {B,, and By» Bi3 ane hanes for G and 
G’, respectively, where the matrices (/(8;, and (/(B;, B;)) are 


0 1 * 
4 


0 -l 0 


respectively, x ¢ ®,. In the first case, R(L(G, 5, f)) = ad L + (ad L)? while 
this is not true in the second. 
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MICHAEL RICH 


ABSTRACT. Let R be a prime nonassociative ring. If the set of 
idempotents of R is a subset of the nucleus of R or of the alternative 
nucleus of R then it is shown that R is respectively an associative or 
an alternative ring. Also if R has one idempotent # 0, 1 which is in the 
Jordan nucleus or in the noncommutative Jordan nucleus then it is shown 
that R is respectively a Jordan or a noncommutative Jordan ring. 


Introduction. The purpose of this paper is to demonstrate that the degree 
of associativity of a prime, not necessarily associative ring can be deter- 
mined from the associativity or lack thereof of the idempotents. Throughout 
we assume that the ring contains at least one idempotent # 0, 1. We consider 
four cases. First, it is easily shown that if R is a prime ring all of whose 
idempotents lie in the nucleus then R is associative. This motivates con 
sideration of the case in which all of the idempotents lie in an appropriate 
alternative nucleus of the ring. Similarly, the result here is that the ring is 
alternative. We next consider a prime commutative ring in which at least 
one idempotent 4 0, 1 lies in an appropriate Jordan nucleus and show that 
this implies that the ring is a Jordan ring. Finally, we consider prime flex- 
ible rings with at least one idempotent in the appropriate noncommutative 


Jordan nucleus with the result being that the ring is a noncommutative Jordan 


ring. Examples are given to show that the conditions assumed are necessary. 
The latter two cases generalize a result of Osborn. 


As usual, the associator (x, y, z) denotes (xy)z — x(yz) and the com- 
mutator [x, y] = xy — yx. Also R* is the same additive group as R, but mul- 
tiplication in R* is given by a * b = 4(ab + ba), ab being the multiplication 
in R. Of course, this is meaningful only if 4a is meaningful for all a in R. 
A ring is called flexible if (x, y, x) = 0, alternative if (y, x, x) = (x, x, y) =0, 
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Jordan if [x, y] = (x?, y, x)= 0 and noncommutative Jordan if it is flexible 


and (x*, y, x)= 0. 


1, The associative case. Let R be an arbitrary nonassociative ring. 
The nucleus N(R) of R is defined by: 


N(R) = {x é€ R\(x, y> z) = (y, Zz, x) = (y, x, z) =0 Vy, ZE R}. 


It is well known [9, Pp. 13] that N(R) is an associative subring of R. 

A ring R is said to have a Peirce decomposition relative to the idem- 
potent e € R if R can be decomposed into a direct sum of the Z modules 
R,, (i, 7 = 0, 1) where R,, = {x € R|xe = jx and.ex = ix}. It is known that if 
R is an associative ring and if e is an idempotent in R then R has a Peirce 
decomposition relative to e. Also, if R has an identity element 1 and if we 


write e, and then eRe. [3]. 


Lemma 1. Let e be an idempotent of the ring R. Then e € N(R) if and 
only if R has a Peirce decomposition R = @R.. (i, 7 = 0, 1) relative toe 
satis/ying the property R;,R,,C BR) for i, j, k, 1= 0, 1 (6 denotes the 
Kronecker delta), 


Proof. Let e € N(R). Imbed R into the ring R’= Z + R which contains 
an identity element 1. Clearly e and 1 - @ are in N(R‘). From our earlier 
remark it follows that Ri =e, Re, for i, 7 = 0,1. Thus Ri R,, = 
(e; Re Xe, Re) =e, e,)Re, Re, 

Conversely, if R= such that Ri anda, beR 


then a= b= Then (a, e, b) = 0 e, ))= 


~k)a;,b,,= 0. Similarly (@, b, e)= (e, a, b)= 0. Thus, 
eéeN(R) 2 

If a ring R contains an idempotent # 0, 1 and if all the idempotents of 
R lie in N(R) then we shall call R a nuclear ring. 


Theorem 1. A prime nuclear ring is associative, 


Proof. Let R be a prime nuclear ring with e 4 0, 1 an idempotent of R. 
By Lemma 1 we have a decomposition R = @R,., i, 7 = 0, 1, relative to e 
with Ri Ry Therefore if i 4 j then Ri. = 0. Thus, for i j, 


2 


ai, 0 so that e + as; is an idempotent of R. Since R is nuclear e + a,,€ 


N(R). Bute € N(R). Therefore a,,€ N(R). Thus Rio 7 Ry C N(R). Since 


N(R) is a subring of R it follows that RoR oy + Ro Rio C N(R). This, 


together with the property Ri Ry S ip allows us to conclude that 
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B= RioRo, + Rio + Ro, + RoR io is an ideal of R contained in N(R). Let 
U ={x € R|xB = 0}. Since BC N(R) it follows that U is an ideal of R. 
Since R is a prime ring UB = 0 implies U= 0 or B= 0. But B= 0 implies 
that R= R,, @Ry. Thus, R,, and Ry are ideals of R such that RR = 
0. From the primeness of R again R,, = Oor Rx) =0. But e €R,, so that 
R,, #0. Also Ry = 0 implies that e is the identity of R contrary to hypoth- 
esis. Thus, B # 0 and U=0. Now, let Tis To973 € R and b € B. Then, 
since b € N(R), r,)b = rb) (R, R, B)C (R, R, N(R)) = 0. 


Therefore, (R, R, R)C U=0 so that R is an associative ring. 


2. The alternative case. Following A. Thedy [10] we define the alterna- 
tive nucleus N,4(R) of an arbitrary ring R by: 


N = {re R|(x, r, x) =0 and (r, yx) =(y,x,7r) = (x,r,y) Vx,y € R}. 


If R is 3-torsion free (i.e. if 34 = 0 for a € R then a = 0) then Thedy has 
shown that Na (R) is a subring of R. 


Lemma 2. Let e be an idempotent of a ring R. Then e € N,(R) if and 
only if R has a Peirce decomposition relative to e satisfying the properties: 

(a) Ry 

(b) CR; 

(c) =0 if j# k and (i, (k, /). 

2 

(d) 0 for any ri, € i#j. 

Proof. Let e be an idempotent in Na (R). Then from the definition of 
N(R) one obtains as in [9, p. 33] 


(1) = (i+ 

and 

(2) (a,b, = (k +1 - 

Thus (a) and (b) follow immediately. Also (d) follows from (749 ri e)=0 
and property (b). To obtain (c) first note that if x € R such that xe = sx 
for some s € Z (ex = tx for some t € Z) then s = Dors=1 (t=Oort=1). 
Now in (1) and (2) let j= 1 and k=0. Then e(4 = (i+ and 
(4;,69))¢ = (J- 1)4;,69) By the preceding remark it follows that i= 0 and 
l= 1, Therefore if @;,6),4 0 then (i, j) = (k, = (0, 1) contrary to hypoth- 


esis. The same argument applies if j= 0 and k=1. 
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Conversely, if R has a Peirce decomposition relative to e satisfying 
(a)—(d) then it is straightforward, using the linearity of the associator, to 
show that (x, e, x)= 0 and (x, e, y)= (y, *, €) = (€, y, *) for arbitrary x, y 
in R. Thus, e € N,(R). 

We call a ring R an A-nuclear ring if R contains an idempotent e 4 0, 1 
and if every idempotent of R lies in N A (R). 

Henceforth, assume that R is an A-nuclear ring, e an idempotent of R, 
and R=R,, + Rio + Roy + Ry the Peirce decomposition relative to e. 


Lemma 3. The set B= R + Rig + Ro, + Ro, Rig ideal of R. 


Proof. By Lemma 2 it is sufficient to show that R;,B + BR;;C B for 


i= 0, 1 which reduces to R,,(R;,Rj,)+ B for i# j. Now by 


(d) of Lemma 2 0 fora,,€R;,i# j. Therefore e+ is an idem- 


potent. Hence € N,(R) if i # j so that (4; 4; 4;;)=— (@;;5 
Since the right-hand side is 0 and we have (a,.a 


ii ij jt 
Thus, ;) Ri; Ri; C B. Similarly, (R;; R CB 
so that B is an ideal of R. O 
Define U,; = {x € + Ro) = + Ro, )* = 08 for i = 0, 1. 


Then we have: 
Lemma 4. U; (i= 0, 1) is an ideal of R. 


Proof. We prove the lemma for U, and note that the same proof applies 
for U,. Clearly U, is an abelian group under addition. Let u €U,, 


aé€R,,+R_,, andr €R. Without loss of generality we may assume that 
r€R,,. Alsoa €N,(R). Therefore (ur)a = u(ra)—(u, Now ra 
and ar €R),. Therefore u(ra)= 0= u(ar). Hence (ur)a= 0, Similarly 
a(ur) = (au)r + (u, a, 7) so that a(ur)= 0. Therefore ur € U,. In the same 


vein ru € U,. Thus U, is an ideal of R. 
Lemma 5. U,B = BU,;=0. 


Proof. We again prove the lemma for U,. Clearly U (Rig + Ro, + Rg Rig) = 
(Rio + Ro, + Ro Ri)U, = 0 by Lemma 2 and the definition of U.. Let 
ue Us, € Rios and ao, € Then since € N,(R), = 
(ua + Since u € U, the right-hand side is 0. 
Therefore u(R 10%.) = 0. Similarly (R 10% = 0. Therefore U,B = BU, = 0 
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Lemma 6. If R is a prime A-nuclear ring then R,, and Ry are associa- 
tive subrings of R. 


Proof. Since R is a prime ring, by Lemma 5 either B = 0 or U, = Uy = 
0. But B =O implies that Sincee €R,,,R,, #0. On the 
other hand, R= 0 implies that R = Ry so that e is an identity element of 
R contrary to hypothesis. Therefore U, = Uy = 0. Now let x, y, z€ Ris 
t+ Roy Then € and (x, y, z)r = [(xy)z]r [x(yz)]r = 
(xy, 2, 7) (x, yz, 7) + (xy) (zr) = (xy, 2, 7) - (&, yz, 7) yy 27) - 
x(y, z,7)= O since r, zr € + Ro, C N,(R) and if a, bE Riot 
Ro,» then (a, b, r) = (b, a) € (Rig + Ro, + R, + Ro, 
0. In the same fashion r(x, y, z)= 0. Therefore (x, y, z) € U; = 0. Thus, 
R,, and R.) are associative subrings of R. 


Theorem 2. If R is a prime A-nuclear ring then R is alternative. 


1 


Proof. Let x, y € R. Then x = y= . So that 


i,j20° 0? i 
(x, x, y)= x, Now if i#j then Yi; € so that, by the 


definition of N,(R), Gt, Y 10) = (x, x, = 0. Thus, (x, x, y) reduces to 
(x 59 Y pp» The terms in S of the form are all 
zero by Lemmas 2 and 6. The terms in S of the form (x for i#j 
are all zero since xi, € Na (R). Finally, the other terms in S come in pairs 
of the form (x + Since j or the sum of 
each of these pairs is zero. Thus S = 0 so that (x, x, y)= 0. Similarly 
(y, x, x)= 0. Thus R is alternative. 

It is worthwhile to note that if R is 3-torsion free then Theorem 2 can 
be obtained more directly. For, in this case, N,(R) is a subring of R. 
Thus B is an ideal of R contained in N,(R). Then by Lemma 3 of [10] 

(x, x, y) € B* and (y, x, x) € B+ where B+ ={r € R|rB = Br= 0}. Since B+ 
is an ideal of R and BB+ = B+B = O while B4 0, it follows that B+ =0. 
Thus R is alternative. 

Theorems 1 and 2 assume that R is prime and that all of the idempotents 
of R lie in N(R), N(R), respectively. The following examples show that 
these conditions are necessary. 

Example 1. Let F be a field and R an algebra over F with basis ele- 
ments e, b, b’, c, { with multiplication given by: e?=e,f?=/,eb=bf=b, 
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eb’ = b'f = b', ce = fc = c, be = e, cb’ = f, and all other products zero. It is 
straightforward to see that e € N(R) and that R is a simple algebra, hence 
a simple ring. However, R is not even alternative since (b, c, b')+ (b’, c, 
b)= b'~b#0. This is due to the fact that e + 6 is an idempotent of R but 
e+b¢ N,(R). Note also that R does not satisfy the Jordan identity 
(x, y, x)= O since ((f + b')’, c, f+ b')=-b'4 0. 

Example 2. Let R be a 3-dimensional algebra over a field F with basis 
e, a, b and multiplication given by: e* = e, ab =a -— b, ba = b, and all other 
products zero. Then e € N(R) and e is the only idempotent of R. Thus, R 
is a nuclear ring. In addition, R is a semiprime ring. However, R is not a 
prime ring since the ideals Fe and Fa + Fb are orthogonal. R is not alter- 
native since (a, b, b)= a - b # 0. Thus, the assumption that R is prime 
is necessary. Here again, R does not satisfy (x’, y, x) = 0. 


3. The Jordan case. Henceforth we must assume that all of our rings R 


satisfy the condition that to each a € R there exists a unique 0 € R such 
that 2b= a. We write b= Ya. It is known [2], [4] that if R is a Jordan ring 
and if e is an idempotent of R then R has a decomposition R = R, + R,.+ 
Ry where R= {x € R|xe = ex = ix}, Also, the modules R_ satisfy the multi- 


plicative properties: 
(i) CR, for i= 0, 1; CR, + Ry, RR = 0, CR, for i= 
0, 1. 
Thus, if a, be R,, then abe R, + Ro We denote this by ab = (ab), + 
(ab),. It is also known that products of elements of the different R, satisfy: 
(ii) (@) 0,2) = &yy)2;+ &y2)¥» = 9, 1. 
(b) OyZy) = yy i= 0,1. 
(€) Vy)? 9 = * 
We define the Jordan nucleus, N(R), of a commutative ring R by: 


= {a € R\(ab)(cd) + (ad)(bc) + (ac\bd) = [b(cd)]a + [b(ac) ld + [b(ad)|c 


= [albc)]d + [albd)le + [alcd)]b for all b, c, de R}. 


Thus, an element a € R is in N(R) if it satisfies the linearized version 
of the Jordan identity. 


Lemma 7. Let e be an idempotent of a commutative ring R. Then e € 
N(R) if and only if the elements of the spaces R, relative to e satisfy (i) and (ii). 
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Proof. (i) and (ii) are established for Jordan rings in [4]. Since the 
procedure in all cases is to linearize the Jordan identity and to specialize 
by setting one of the elements equal to e we may conclude immediately that 
ee N(R) implies (i) and (ii). 

One may verify directly that if (i) and (ii) are satisfied then e € N 68) 
by setting ¢=e in the definition of N(R) and decomposing , c and d into 
their components. The proof is straightforward but the computations are 
lengthy. We do not present the computations here. O 

If R is a commutative ring with at least one idempotent e # 0, 1 lying 
in N y®) then we call Ra J-nuclear ring. Osborn has shown {el, 7, Proposi- 
tion 6.7] that if R is a commutative ring satisfying (i) and (ii) then R is a 
Jordan ring if and only if R, and R, are Jordan rings. Thus if R is simple 
then R is Jordan. The following theorem draws from and generalizes 
Osborn’s result. 


Theorem 3. If R is a prime J-nuclear ring then R is a Jordan ring. 


Proof. Let e be an idempotent 4 0, 1 in R such that e € N(R). By 
Lemma 7 we have (i) and (ii). Let A=(R “1 + Ry + (Ry Ry It fol- 
lows from (i) and (ii)(b) that A is an ideal of R. Also, let C; = {x € 

y= 0} for i= 0, 1. It follows from (i) and (ii)(a) that Cis i= 0, 1, is 
an ideal of R. Also, from (i) and (ii) (b) AC, = AC, = 0. Since R is a prime 
ring either A = 0 or C, = 0. But A = 0 implies that R= R, 
This, however, is impossible as in Theorem 2. Therefore C, = C, = 0. 

From (ii)(a) we have a homomorphism ¢@, from R, into Hom(R ys R,)* 
with Ker = C, for i= 0,1 [2]. Since C, = C) = Owe have R, and Ry 
imbedded in the Jordan ring Hom(R,,, Therefore R, and are 


Jordan rings and by [7, Proposition 6.7] it follows that R is a Jordan ring. 


4. The noncommutative Jordan case. Recall that a ring R is a non- 
commutative Jordan ring if it is flexible and satisfies the identity (x?, Vs 
x)= 0. It is known [1], [5] that if e is an idempotent of a noncommutative 
Jordan ring R then R has a decomposition R = R, + R,, + Ry relative to e 


where R, = {x € R|xe = ex = ix} for i= 0, 1 and R,,= {x € R|xe + ex = x}, 


Multiplication among the R. is given by: 
(iii) RF CR,, R,Ry+ Ry Ry, i= 0, 1, = RoR, = 0 and if 
x, y € Ry, then xy + yx €R, + Ro. 
Assume now that R is a flexible ring in which for every a in R there is 
a unique 5 in R such that 2b= a, We define the noncommutative Jordan 
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nucleus, Ny R)s of R by: 


XZ+ZX 


for all x,y,z in R} 
where E, F =7, l and a ) denotes right (left) multiplication by the element 
x. It is a straightforward matter to show that N nyR) CN yR*). The prop- 
erties (iii) are obtained for noncommutative Jordan rings by linearizing the 
Jordan identities and setting one of the variables equal to e. McCrimmon 
[5] has shown by the same method that 


(3) e(zy+yz)=zy, (yz+zyle=yz if yeR, and zER,,, 
and 
zl + and = zl + 27,7, 
if x, y€R, and zER, 
If R contains an idempotent e 4 0, 1 such that e € N ny®) then we 
shall call R an NJ-nuclear ring. Thus, in an NJenuclear ring (iii), (3) 


and (4) hold. Similarly, we have 


(3') elzy+yz)=yz, (yz+zyle=zy if yeR, and zER,,, 


and 


(4) 
if x,y ER, and z€R, ,,. 


For, since R is flexible, J, - 7 for alla, beR. In par- 


ticular, if a=e, y € R, and we allow this to act on z € Ry we get yz—- 
e(yz) = zy — (zy)e or yz — zy = e(yz)—(zy)e. Add and subtract e(zy) to 
the right side of this equation to get yz — zy = e(yz) + e(zy)— zy. There- 
fore yz = e(yz) + e(zy). The second half of (3’) follows in a similar manner. 
For the first half of (4) ler E=1, F =1r,a=-e,%x € Ri» and z€ Ry, 
in the definition of Ny,(R) to get 71+ 


+zx? 


which, by flexibility, reduces to + = 0. If we allow 

this to act on y € R, we get (xy)z — x(yz) + [(xz + zx)yle — (xz + zx)y=0. 
Again, in the definition of let x € R,,a=2z =e to obtain 
By flexibility [E, There- 
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fore, we have 
(5) if x eR). 
Therefore [(xz + zx)yle = [(xz + zx)ely = (zx)y by (3'). Thus, we now have 
(xy)z — x(yz) — (xz) y = 0 which reduces to = zl, 1+ Tye Similarly 
if we lee E=r, F=1,x € R,,z € Ry, and a=e we get the second half 
of (4’). 

Lemma 8. Let R be an NJ-nuclear ring with R \xRy, = = 
0} fori=0,1. Then K, is an ideal of R, 


Proof. If i= 0 this follows from (iii) and (4) while if i= 1 it follows 
from (iii) and (4’). 

Lemma 9. If R is an NJ-nuclear ring and ix € R |x Ry = 0}, i= 
0, 1 then K; = C . 


Proof. Clearly C . Let y € Cs ze Ry. Then yz +zy=0. Then 
if 7= 0, (3) gives yz =-zy = 0; whereas, if i= 1, one gets the same result 
from (3'). Thus,y €K, 

We have noted earlier that if x € R, and z € R,, in an NJ-nuclear ring 
then 


eztax?%e!= 0. From flexibility we also get [/,,7,] + 


0+ If we allow these to act on y € Ry, we obtain: 
(6) (xy)z — x(yz) + + zx)yle — (xz + zxye) = 0 

and 

(7) (zy)x z(yx) + (eyxz + zx) ely(xz + zx) =0, 


if y,z and x ER.. 
Similarly, if x € Ry, z € R,,and a=e in the definition of Ny)(R) we 
get F + [E 


Sate F] = 0. If we allow this to act on y € Ry, we 


obtain: 

(6') x(yz) — (xy)z + ely(xz + zx)] - (ey xz + zx) = 0 
and 

(7') (zy)x — z(yx) + + zx)yle (xz + zxYye) = 0, 


if y,z€R,,, and xERo. 
We are now able to prove: 


Theorem 4. A prime NJ-nuclear ring is a noncommutative Jordan ring. 


Proof. We first show that Ky= K, = 0. As in Theorem 3 let A = 
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(Ry Ryo + Ry, + (R,,R y),+ Then as in [5, Lemma 2] A is an ideal of R. 
Now by (iii), (6), and (7), AK, = KA = 0; whereas by (iii), (6'), and (7’), 
AK, = K,A=0. Now, if A = 0 then R,, = 0 which is impossible since R 
is a prime ring. Therefore K, = K)= 0. Thus, by Lemma 9, C, = C, = 0. 
Therefore R* a in which C, = C,=0. As in Theorem 3 it 
follows that R} and R3 are Jordan tings. sa by [6], [7], R* is a 
Jordan ring. i R is flexible and R* is Jordan, it follows [8] that R is a 
noncommutative Jordan ring. 


Finally, note that our Example 1 earlier shows that it is not true that 
in a prime nonflexible ring ¢ € Njy,(R) implies that R = N(R). 
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ABSTRACT. N. Velitko generalized the well-known result of A. D. 
Taimanov on the extension of continuous functions by showing that Tai- 
manov’s theorem holds when Y (the image space) is H-closed and Urysohn 
and the mapping f is weakly 6-continuous. We obtain, in a more direct 
fashion, an even stronger generalization of this theorem. 

We proceed to show that the class of all SW spaces is not reflective 
in the category of all completely Hausdorff spaces and continuous map= 
Pings. However, an epi-reflective situation is achieved by suitably en- 
larging the class of admissible morphisms. 

We conclude by establishing a number of results about SW exten- 


sion spaces. 

1. Preliminaries. A subset A of a space X is said to be a zero-set of X 
if there exists a function / in C(X) (the set of all continuous, real-valued 
functions on X) such that A = f~!(0}) = {x € X: /(x) = 0}. Complements of 
zero-sets are called cozero-sets. If C*(X) is the set of all bounded func- 
tions in C(X), the subset A of X is said to be C*-embedded in X if every 
function in c*(A) can be extended to a function in C*(X) (11). If X and Y 
are spaces, let C(X, Y) denote the set of all continuous functions from X to Y. 

A mapping / of the space X into the space Y is said to be 0-continuous 


(weakly @-continuous) if for an arbitrary point x € X and an arbitrary open 
set V of Y containing y = /(x), there exists an open set U of X with x € U 

and f(cl,U)G(U))C cl ([8], [19]). The point x is a member of the 0- 
closure of the set S in X if and only if (cl, G) S$ #@ for all open sets G 
containing x. The set S is said to be @-closed if it is equal to its 0-closure [25]. 


A space X is said to be quasicompact if every family of zero-sets of X 


with the finite intersection property has a nonempty intersection [9]. The 
space X is said to be Urysohn if distinct points of X are contained in dis- 
joint closed neighborhoods, and is said to be completely Hausdorff if for 
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every pair x, y of distinct points there is a function / in C(X) such that 
{(«)# {(y). The word space, unqualified, shall henceforth mean a completely 
Hausdorff space. As in [21], the space X is said to be a Stone-Weierstrass 
space (or briefly, an SW space) if every point-separating subalgebra of 

c*(x ) which contains the constants is uniformly dense in C*(x ). 

A mapping /: X — Y, where X, Y are arbitrary spaces, is said to be 
cozero-set continuous if fe ) is open for all cozero-sets C of Y. Cozero- 
set continuous functions will be referred to as c-maps. If X is a space, let 
x be the space obtained by taking on the same set X the weak topology 
relative to C(X). As noted in [3], X is SW if and only if X is compact. 
Moreover, a a map { from an arbitrary space X to Y is a c-map if and only if 
Y is continuous, where Y Y is the identity map. 

A Hausdorff space X is said to be absolutely closed, or simply H- 
closed, if it is closed in every Hausdorff space in which it can be embedded. 
This concept is a generalization of a property of compact Hausdorff spaces, 
and was introduced in 1924 by Alexandroff and Urysohn [1]. In [15], Katétov 
showed that any Hausdorff space X could be densely embedded in an H- 
closed space xX, now referred to as the Katétov extension of X, having the 


property that X is a C*-embedded subset. For a construction of kX » the 
reader is referred to [18]. 


A filter ¥ on a space X is said to be completely regular if ¥ has a base 
B of open sets such that for each set A € ® there exist a set B € 8 con- 
tained in A and a function { € C(X) which is equal to 0 on B and 1 on X\A 
[5]. The filter ¥ is said to be free or fixed according as the intersection of 
all its members is empty or nonempty. 

The space Y is said to be an extension of the space X if there exists a 
homeomorphism 4 from X into Y such that /(X) is dense in Y. If 4 is the 
identity map, the reference to is omitted. The extensions Y and Z of X 
are said to be isomorphic if there is a homeomorphism of Y onto Z which 
leaves X pointwise fixed. 

An arbitrary topological space X is said to be realcompact if every 
real maximal ideal in C(X) is fixed [6]. 

An open filter is a filter in the lattice of open sets. The open filter a 
is said to have the countable closure intersection property (abbreviated 
c.c.i.p.) provided that for each countable subset of @, Mac: 
An open ultrafilter is a maximal open filter. 

A Hausdorff space X is said to be almost realcompact if every open 
ultrafilrer with the c.c.i.p. converges. 
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2. Extension of maps. The following theorem is proved by Taimanov 


in [23]. 


(2.1) Let A be a dense subspace of an arbitrary space X, and let f: 
A — Y be acontinuous mapping of A into the compact Hausdorff space Y. 
The mapping { has a continuous extension from X to Y if and only if, for 
every pair F,, F, of closed disjoint subsets of Y, we have el, ,) nN 


It is easily verified that in the above theorem we may replace ‘“‘closed 
disjoint subsets’’ by ‘‘disjoint zero-sets’’. 


Lemma 2.2. Let {: X — Y be a map from an arbitrary space X to an H- 
closed Urysohn space Y, Then the following conditions are equivalent: 

(a) is 0-continuous, 

(b) f is weakly @-continuous, and 

(c) is a c-map, 


Proof. That (a) implies (b) is obvious. A weakly @-continuous function 
is always a c-map and therefore it remains to prove that (c) implies (a). 

Suppose p € X and that /(p) € V, where V is open in Y. An H-closed 
Urysohn space is an SW space [18] and hence completely Hausdorff. There 
is for each q € Y\{/(p)} a function hb, in C(Y) with 4 q(@) = O and h gfe) = = 
1. It is clear that ={ly eY: ie ate 
b, OVS Y} is a zero-set of Y, and ycUic,: UV, 
The space Y is H-closed, and so there exist elements 919959 939°" "9 Ty 


of with YCUZ,clyC, UclyV=U%_,D, UclyV [16]. Since 


U;. Yagi O, ae E is a zero-set of X and p € AE ax is an open set U 
of X with p€UCcl,UCX\E. Clearly f(cl, U)C clV and thus 
{ is 0-continuous. 


The following theorem generalizes and follows from (2.1). 


Theorem 2.3. Let A be a dense subspace of an arbitrary space X, and 
let {: A — Y be a c-map from A to the SW space Y. The mapping { has a 
c-extension from X to Y if and only if, for every pair F ,, F, of disjoint 
zero-sets of Y, we have cly/~'(F,) ‘a cl, =f. 


Proof. That the condition is necessary follows from the inclusion 


where g: X — Y is a ceextension of /. To see that 
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the condition is sufficient, we note that disjoint zero-sets of Y are disjoint 


zero-sets of Y and hence Yyl: A — Y extends to a continuous map /: X 


Y by (2.1). The function h: X — Y, defined by y,> = /, is a c-map and 
= f. 


Corollary 2.4. Let A be a dense subset of an arbitrary space X, and le: 
{: A — Y be weakly @-continuous where Y is H-closed and Urysohn, Then 
the following conditions are equivalent: 

(a) { has a weakly @-continuous extension from X to Y, 

(b) for any pair F,, F, of 0-closed disjoint subsets of Y, we have 
cly/~'(F,) 

(c) for any pair Fis F, of disjoint zero-sets of Y, we have af?) 


Proof. (a) => (b): Suppose g is the weakly @-continuous extension of /. 
If pe cl, then g(p) is, easily, a member of the @-closure of 


(b) =» (c): We need merely observe that zero-sets are 0-closed. 

(c) =» (a): The function f is a c-map by Lemma 2.2 and therefore has a 
c-extension g from X to Y by Theorem 2.3. Again, by Lemma 2.2, g is weakly 
6-continuous. 

In the above corollary, there are simple examples showing that we may 
not replace ‘weakly @-continuous’’ by ‘“‘continuous’’. On the other hand, 
by Lemma 2.2, ‘tweakly @-continuous”’ may be replaced by ‘‘@-continuous”’ 
or ‘‘c-map’’. 

Veliéko generalized Taimanov’s theorem by showing that, under the 
hypothesis of Corollary 2.4, (a) is equivalent to (b) [25]. Stephenson [21] 
has shown that there exists a noncompact regular SW space Y. Since a 
regular absolutely closed space is compact, Y cannot be absolutely closed. 
Thus, Y is seen to be an example of an SW space which is not H-closed and 
so Theorem 2.3 covers a wider class of spaces than Velitko’s result. 

Almost realcompact spaces were defined and studied by Frolik in [10], 
where he showed that in many instances they behave much like realcompact 
spaces. In [7], Engelking gave the analogue of Taimanov’s theorem for com- 
pletely regular realcompact spaces: Let A be a dense subspace of an arbi- 
trary topological space X, and let /: A — Y be a continuous function of A 
into the completely regular realcompact space Y. The mapping / has a con- 


tinuous extension from X to Y if and only if, for any sequence iF ir of 


closed subsets of Y such that = 2, we have \(F,) 
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It is a simple matter to establish the counterpart of Theorem 2 for completely 
Hausdorff realcompact spaces. In the same vein, we have 


Theorem 2.5. Suppose Y is almost realcompact, xY is an SW space, A 
is dense in the arbitrary space X, and {: A —+ Y is weakly @-continuous. 
The mapping { has a weakly @-continuous extension from X to Y if and only 
if for any sequence vi. of @-closed subsets of Y such that N;_4F; = 
, we have FD =f. 


Proof. To prove that the condition is necessary, we need merely argue 
as in (a) =» (b) of Corollary 2.4. We now establish the sufficiency of the 
condition and first note that { may be regarded as a weakly 0-continuous 
function from A to «Y. If H, and H, are disjoint 6-closed subsets of KY, 
then H, 9 Y and H, Y are disjoint 6-closed subsets of Y, and therefore 
cly/~"(H,) Aclyf~"(H,) = cl, cl, NY)=S. By 
virtue of Corollary 2.4, { has a weakly @-continuous extension g from X to 
KY. It remains to show that g(X)C Y. 

Suppose, on the contrary, that there is a point p of X\A such that g(p)= 
@exY\Y. Now @ is an open ultrafilrer on Y which does not have the 
c.c.i.p., and so there exists a countable subset C = Ga, of @ with 
Since is H-closed and Urysohn, is 0-closed for 


all positive integers i [24], and letting F,=clyG, it follows that 


There exists a positive integer j such that 


pe X\cly/~(F), and we observe that G, u {Q} is open in «Y and contains 


@. If U is an arbitrary open subset of X which contains Pp, choose a point s 
of NUNA, Now s ¢ clyf~'(F,) and hence s ¢ 
so that g(s)= f(s) ¢ clyG.. It follows that g(s) € Y\clyG., an open subset 
of KY which does not intersect G; U {@}. Hence g(U)¢ clyylG.u {@}], and 
so g is not weakly 9-continuous at p. 

Remarks. Porter and Thomas have given necessary and sufficient con- 
ditions on X for KX to be an SW space [18]. 

It is easily verified that Lemma 2.2 is still valid if it is required merely 
that KY be Urysohn; thus in the above theorem, ‘‘weakly @-continuous’’ may 
be replaced by ‘‘@-continuous”’ or ‘‘c-map’’. 


3. Reflectiveness of SW spaces. Many extensions such as the Stone- 
Cech compactification, the Hewitt realcompactification, and the Banaschew- 


ski zero-dimensional compactification have, on account of their similar 
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mapping properties, been studied from a categorical standpoint and classi- 
fied as epi-reflections in appropriate categories. For a thorough discussion 
of this theory, the reader is referred to [13]. 

We will not distinguish among isomorphic objects of any category, and 
for any category, 1, will denote the identity morphism for the object X. For 
categorical notions not specifically defined, the reader should consult 
Mitchell [17]. 

Definition. If & is a full subcategory of a category 8 and if for each 
object X in B there exist an object Xy in WU and a morphism (resp. epimor- 
phism) r: X —* Xy such that for each object Y in Y and each morphism /: 
X — Y, there exists a unique morphism i: Xy — Y such that the diagram 


r 
x 


is commutative, then 2 is said to be a reflective (resp. an epi-reflective) 
subcategory of 8 and r is called a reflection morphism (resp. epimorphism) 
from X to Xy. 

In establishing our next theorem, the techniques employed in Theorem 
1 of [12] were most useful. We will furthermore lean heavily upon the fol- 
lowing modification of Niemytski’s classic example [11, 3K]. Let X = P = 
i(x, y): OS *< 1, OS y< 1} be the unit square with the usual topology 7, 
and let A ={(x, 0): (x, 0) € X}. To each (x, 0) € A define V, = i(x, 0} U 
{(u, v) €X:v>Oand u-x)? +0? < (4)*4. Let 7, be the topology on X 
generated by the collection of sets 7, U (V7 28 a subbase. It is easily 
verified that (X, r,) is H-closed and Urysohn and hence SW, and that A with 
the induced topology is discrete. 


Theorem 3.1. Let 8 be the category of all completely Hausdorff spaces 
and continuous functions, and let Ul be its full subcategory of all SW spaces. 
Then & is not reflective in 8. 


Proof. Suppose, on the contrary, that 9 is reflective in 8. Consider 
the space (X, r,) described above, and let 7 be the reflection morphism 
from A to the SW space Ay. If i: AX is the identity map, there is a 
unique morphism i: Ay — X such that i=i °r. Since i is a homeomor- 


phism into, it follows readily that r is a homeomorphism into. 


/ 
/ 

f /f | 
/ 

Y 
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Let D, be the discrete space composed of two elements, 1 and 2, let 
P=Xx D,, and for n= 1, 2, let in? X — P be the map defined by 1,0) = 
(y, 2). For each y € i(A) identify 1,9) and 1,0); let QO be the corresponding 
quotient space, and let x be the quotient map from P to Q. Now X and D, 
are H-closed and it follows that P and hence Q is H-closed. One can easily 
check that Q is Urysohn and therefore SW. 

It is now possible to proceed exactly as Herrlich and Strecker have done 
in [12] to show that A is homeomorphic to the SW space Ag: this is a con- 
tradiction since A is not quasicompact. 

Let a, be the set of all nonisomorphic SW extensions Y of X such that 
X is C*-embedded in Y, and let e, denote the set of all those members of 
ay with the property that each trace filter is completely regular. 

Stephenson [21] introduced and studied a particular member of ey, which 
we denote by oX. Specifically, if J is the set of all free maximal completely 
regular filters on X, then 0X is the space whose points are the elements of 
X u Jl and whose topology is generated by all sets V* of the form V U 
iF € M\V € F} for V open in X. The space 0X enjoys many of the properties 
of the Stone-Cech compactification of a Tychonoff space and is, in fact, 
homeomorphic to BX in case X is completely regular. 

In [20], Raha has described an extension of a space X, which we denote 
by 5X, whose points are again the elements of X U M and whose topology 
is similar, in construction, to the topology of the Katétov extension. In 
particular, any set, open in X, is also open in 5X, and if F eM, basic neigh- 
borhoods of F are sets of the form GU {F} for Ge F. It is easily verified 
that dX €e,. 


Lemma 3.2. If Y € a, and {: X — Z is a c-map from X to the SW space 
Z, then there exists a unique c-map g: Y — Z with g|X =f. 


Proof. Let F, and F, be disjoint zero-sets of Z. The sets A, = 
fF ,) and A, - {-\(F,) are disjoint zero-sets of X, and so there is an 
element / of C*(X) which is 0 on A, and 1 on A, [11]. Now / can be extended 


to a function in c*(Y) which implies that clyA, nN clyA, = 2%. By Theorem 


2.3, there is a cemap g: Y — Z with g|X =/. The uniqueness of g follows 
from the uniqueness of y78- 


Theorem 3.3. Let 8" be the category of all spaces and c-maps. If 


u* C B* is the full subcategory of all SW spaces, then the natural mappings 
r: X—» oX andr,: X — 6X are reflection epimorphisms for U*, 
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Proof. The composition of c-maps is a c-map, the identity function is 
a c-map, and therefore B* isa category. Since X is C*-embedded in 0X and 
5X ((21], [20]), the proof now follows directly from Lemma 3.2. 


4. Projective extrema. If Y is an extension space of X, the trace filters 
of Y are the filters Jl(y), y € Y\X, where Jl(y) is the filter on X generated 
by the traces UX of the open sets U of Y which contain y. If X is 
Tychonoff, then the trace filters J\(y) of BX are precisely the free maximal 
completely regular filters on X ((2], [5]). 

The extension Y of X is said to be projectively larger than the extension 
Z of X, denoted Y > Z, if there exists a continuous surjection /: Y ~ Z 
which leaves X pointwise fixed. If 7 is a class of extensions of X, an ele- 
ment Y of 7 is said to be a projective maximum (resp. projective minimum) 
if Y>Z (resp. Z > Y) for all Z in n. Projective maximums (resp. projective 
minimums), if they exist, are unique [4]. 

We are now in a position to give a simple proof of the following theorem 
due to Stephenson [21, Theorem 4(vii)]. 


Theorem 4.1 (Stephenson). The projective minimum of e, is oX. 


Proof. If Y € ey, let 70) denote the trace filter of Y corresponding to 
ye Y\X. Noting that px = Y and that 7) is a subset of the completely 
regular filter n(y), we must have 7(y) = ni). Let g: Y — oX be the func- 
tion defined by g(x) =x for x € X and g(y) = nly) € Mfory € Y\X. VU 
ig eM: V e GC} = T is a basic open set of 0X, then eg (T)= VU 
fy € Y\X: V € n(y)} which is open in Y by Lemma 4.1 of [18]. Thus, g is 
continuous. 

It is clear that g(Y) is quasicompact and thus SW [3]. It follows that 
g(Y) is closed in oX [21], and therefore g is onto. 

Stephenson also proved that the function g in the above theorem is 1-1. 
From the manner in which we have defined g, this follows immediately from 
the fact that Y is completely Hausdorff. 

Porter and Thomas [18] and Liu [16] have shown that the Katétov ex- 
tension is a projective maximum in the class of H-closed extensions of a 
Hausdorff space X. In view of its affinity with the Katétov extension, it is 


natural to inquire about the role of 5X as a projective maximum. 


Theorem 4.2. If Y € ay, then 6X > Y if and only if Y €e,. 


Proof. If 5X > Y, then for any y € Y\X there is an @ € M such that 
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@. Since (y) is a maximal completely regular filter and 1) Cc nly), 
it follows that n(y)=@. Hence Y € Cys 


On the other hand, suppose Y €e,. The identity map 7: X — Yisa 
c-map, 5X is a reflection epimorphism for i and therefore 7 can be extended 
to a c-map /: 5X — Y. We claim that /(M)C Y\X. For if ((@)=~x €X, let 
D be the class of all cozero-sets of X which contain x. Since / is a c-map 
and X is C*-embedded in Y, it follows that DC @. Now 9) is a base for a 
fixed maximal completely regular filter, and so @ is fixed which is a contra- 
diction. 

It is clear that f is continuous at each point of x. If {(@)= y € Y\X, 
let U be an open set Y which contains y. Since n(y) is completely regular, 
ny) =7(y) which entails the existence of a cozero-set C of Y containing y 
with CXC U. Since / is a c-map, there is a member G of @ with 
Clearly, /(G U {@}) U and so f is continuous at y. That / 
is onto follows as in Theorem 4.1. Thus 5X > Y. 


The following corollary is analogous to a result of Banaschewski in [4]. 


Corollary 4.3. If X is a space, then oX < Y< 6X forall Y ine,. 


Remarks. The set ey (and hence also a) may have substantial cardi- 
nality. We shall make use of the fact that any Hausdorff extension Y > X 
such that 0X < Y < 6X belongs to e,. Let N be the space of positive inte- 
gers with the discrete topology, let Y= N UM, and if @ eM, let Tq be the 
topology on Y generated by the topology of oN together with {NU {(}}. 
Clearly oN < (Y,7@)< and so (Y, 7g) € ey. If @ and B are distinct 
members of JI, a routine argument shows that (Y, Tg) and (Y, 7g) are non- 
isomorphic extensions of N. Finally, since aN is the Stone-Cech compac- 
tification of N, it follows that 2° = card M<carde, [11]. 

It is natural to ask if oX is a projective minimum in a,. We shall 
answer this question negatively, but we will first need to describe another 
SW extension of a given completely Hausdorff space X. Let @ be the set of 
all free zero-set ultrafilters (see [11]) on X, and let 7X = X U @. We define 
a topology for 7X by taking as a base for the open sets the family of all 
sets of the form G U{@ € @: 3A € @ with A C G} where G is any open set 
of X. It is readily verified that 7X is SW and that X is a dense, C*-embedded 
subset. 

Let I = [0, 1], let 7 be the usual topology on I, let J be the subset of | 
consisting of all irrational numbers, and choose disjoint dense subsets J ,, 
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J, of (I, 7) such that J = J; U J,- Let 1, = I\J55 let r, be the topology 
on I, induced by 7, let 5, be the topology on I generated by 7,u iy} 
and denote the space by P. A routine argument shows that (/ 


and P have the same continuous functions, and so 7, is the collection of 


1 
cozero-sets of both (I ? r,) and P, 


Suppose g € C(7P, oP) and g|X is the identity map. Since no cozero- 
set of P is contained in J,, the set J; is open in oP. However, if pe UC 
J, where U € 5) then U contains a member of a free zero-set ultrafilter on 
P, and hence a7 *,) = J, is not open in aP, This is a contradiction, and 
it is now evident that oP is not a projective minimum in Ap 

Clearly 7P € a p\e ps and it follows from Theorem 4.2 that 5P # P. 
Therefore 5X is not necessarily the projective maximum of 2, and this 
disproves a theorem of Raha [20]. 

Although OX is not in general a projective minimum in a, we do have the 
following result. 


Theorem 4.4. If X is Tychonoff, then oX is the projective minimum in a 


x 
~ ~ 
Proof. If Y €a,, then Y = BX = oX; hence yy: Y—Y is the desired map. 


However, even if X is Tychonoff, 5X need not be the projective maxi- 
mum of a. For in [21], Stephenson has described a Tychonoff space x 
with a naite noncompact SW extension Y. Moreover, X is C*-embedded 
in Y. If Y=X Uly} and n(y) were completely regular, then one could check 
the various cases to show that Y would be Tychonoff and hence compact 
((3], 14}. Hence Y € ay 
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ABSTRACT. Proximity, contiguity and nearness structures are here 
studied from a unified point of view. In the discussion the role that 
grills can play in the theory is emphasized. Nearness structures were 
recently introduced by Herrlich and Naimpally. Thron pointed out the 
importance of grills in proximity theory. Nearness structures v are then 
used to generate proximity extensions (¢, ir’. N”)) of a given LO- 
proximity space (X, IM), where Finally, the relation of the extens 


sions (¢, er. n’)) to arbitrary extensions (i, (Y, m*)) is investigated. 


1. Introduction. It was shown by Smirnov [16] that EF-proximities can 
be used to generate all T ,-compactifications of a given Tychonov space. 
Somewhat later Ivanova and Ivanov [8] introduced contiguity structures and 
showed that they can be employed to obtain a large class of T ,-compactifi- 
cations of a given T ,-space. The concept of contiguity was further inves- 
tigated and slightly modified by Terwilliger [17]. Very recently Herrlich, 
Naimpally, and Bentley [6], [12], [2] have introduced nearness structures 
and have applied them, among others, to the study of extensions of spaces. 
Also recently Thron [19] brought out the importance of grills in proximity 
theory. 

All of these ideas and concepts are brought to bear here on the study 
of proximity extensions of proximity spaces. We introduce a construction 
which may have been first suggested by Bentley (see [14]) and is similar 
to one employed by Herrlich to obtain completions of N-spaces. The con- 


struction associates with every nearness structure v, compatible with the 


given proximity II on X, proximity extensions (X”, II”) of the original 


space (X, II). This is done in $3. That the simple construction of proximity 
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extensions, employed by Leader [10] for EF-proximities cannot be extended 
to LO-proximities was recently shown by Naimpally and Whitfield {14]. In 
$4 we investigate to what extent all proximity extensions can be obtained 
as (X”, II”). 


In $2 we take another look at the definitions of proximity, contiguity, 


and nearness. This is done partly to emphasize the importance of the con- 
cept of grill, which appears naturally in A@l) as well as in maximal A-com- 
patible families (for A a contiguity or a nearness). We are also able to bring 
out the similarities as well as the differences between the three types of 
structures. 

A structure A shall be called clan (bunch) generated if it satisfies the 
condition 


W € A A-clan (bunch) G such that 


It is known [19] that all basic proximities are clan generated. In $2 we 
show that the same is true for all basic contiguities. Very recently Naim- 
pally and Whitfield [13] have given an example of a nearness which is not 
clan generated. It follows that in this important respect nearness structures 
are much more complicated than proximities or contiguities. 

Bunch generated structures are exactly the ones which can be topologi- 
cally induced. A structure A on X is said to be topologically induced if 
(X, ¢,) can be embedded via a map ¢ in a topological space (Y, d) and U = 
[A,:i € 1] €A if |&| is appropriately restricted and iell#g. 
Here c, is the closure operator induced by A (see Definition 2.5). For 
details on this result see Bentley [3]. 

In what follows there is always an underlying nonempty set X and fre- 
quently also a set Y DX. It will be convenient to denote elements of X or 
Y by x, y,---, Subsets by A, B,.... Families of subsets will be denoted 
by Ul, B,.... In particular % will be used for filters, U, & for ultrafilters, 
and & for grills. Letters a, B, y,... shall be used for collections of families 
of sets (i.e. aC P(%(X))). For nearness structures we shall use v, Pocces 
for contiguities €, €,..., a collection which may be any of the three struc- 
tures shall be denoted by A;.... However, for proximities we shall continue 
to use II. 

In analogy to its use for relations we shall employ the notation A(2!) to 
mean A(2l) = [A: [A] UL EA]. In addition shall be simplified to 
A(x) and TI({A]) to TI(A). Otherwise we shall refrain from using abbreviations. 
In particular we shall write €A or ¢A. The notation |A], |%|,... refers 
to the cardinal number of the set under consideration. 
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Clusters were initially defined for proximities by Leader [10] as A- 
closed A-clans (see Definition 2.8). We use this definition also for conti- 
guities and for nearness structures, for both of which one can prove (Theo- 
rems 2.4 and 2.5) that the A-closed A-clans are exactly the maximal A-com- 
patible families. Thus there is no real conflict between our definition and 
that of Herrlich, Naimpally, and Bentley [6], [12], [2] who, for near struc- 
tures, define a cluster as a maximal A-compatible family. In order to save 
space many straightforward proofs shall be omitted or given only in outline. 
The authors would also like to thank S. A. Naimpally and the referee for a 
large number of valuable comments. 


2. Proximities, contiguities, and nearness structures. We begin by re- 
calling the definition of a stack and a grill. 

Definition 2.1. A family Gof subsets of X is called a stack on X if it 
satisfies A>BEG=A€EG A stack G on X is called a grill on X if it 
satisfies the conditions @¢G; AUBEG=A cGorB eG, 

A proximity is usually considered as a relation on X, but since it is 
assumed to be a symmetric relation it can be taken to be a collection of two 
element families [A, B]. This enables us to make the following definition. 

Definition 2.2. A collection II of families of subsets of X is called a 
basic (or Cech) proximity on X if it satisfies the requirements: 


Py: Le = 2, 
P,: [Uj=2, NU4 UeN, 
P,: IM(A) is a grill on X for all A CX.. 


The equivalence of this definition to Cech’s [4] is established in [19]. 


In Terwilliger’s modification of Ivanova and Ivanov’s definition of a 
contiguity the LO-condition and separatedness are still included. We remove 
these conditions in defining a basic contiguity. 

Definition 2.3. A collection € of families of subsets of X is called a 


basic contiguity on X if it satisfies the conditions: 
Co: We E— < 
C,: < x, NUA SVU ee, 
C,: &(U) is a grill on X for all Uc P(x), 
C,:BcUc EBe €, 


For every infinite cardinal number C one can define a C-contiguity by 
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replacing the requirement |®l| < in Cy and C, by 


It is helpful to introduce an operation @ as well as a relation > on 
families of subsets of X. We have 


Be B) 
and 


B >We 8 such that BDA. 


In terms of this notation we can, following Naimpally [12], define a basic 
(or Cech) nearness as follows: 


Definition 2.4. A collection v of families of subsets of X shall be 
called a basic (or Cech) nearness on X if it satisfies: 


By: NU 

B,: 

B,:B>U and Uev—Bev, 
By U¢dv, 


In the sequel it will be convenient to omit the prefixes ‘‘basic’’ or 
**Cech’’. Thus a nearness is understood to be a basic nearness and simi- 
larly for proximities and contiguities. 


With these definitions we are able to prove: 


Theorem 2.1. (a) Let |U|< Xp, |B\ < NX, and let € be a contiguity then 
(i) 
(ii) BLERUOSB LE. 
(b) U eA = UCACQ), where dr may be a proximity, contiguity or near- 


ness, 


(c) If v is a nearness on X then v(XL) is a grill on X for all UC BX). 


Proof of (a). Let 8 = [Bi seoes B i. If 8 > U then for every B, there 
exists an A, € U, such that B, DA,. Here A, = Ais k# j, is possible. Set 
[A A], then U'c U. Hence by C, and the assumption 
we have UW’ ec Set B, Al. Then € since 
from A, € &(IA,,.. it follows by Cc, that B, &(lA,, and 


hence that Ui €. Now assume that Then A,,, € ~ [A,, 


and hence B,,, € EU, ~ [A,, i), that is eed € € By induction we thus 


arrive at Y= 8 € €. This establishes (i). We now turn to the proof of (ii). 


z 
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Ser OB=C. Further, let U = [A,,---,4,], B=[B,,..., and 
define U_ = [A i<r], = [B,:i< s]. Then and 8 = 8 


m+i1° 


Assume © € €. Either UC =BuUC € é, in which case 8B € € follows 
from C,, or there exists a least k,1<k<m+1 such that 3, UC £€. 

Since 8, =@ and Su © =€ €€ we must have k>1. Set r=k-1, then 
B uC Further, if UC) then (BJUB 

U © € &, which is a contradiction. Hence €€ and B. ©), 


We next observe that since = @ it is true that UB Let 


1<t<m. Assume that we know that Bu © Now A,v B. 
= BUS, Hence AU UB YU Since ¢ 

©) it is true, a fortiori, thar ¢ ECL, UB UC). This fact, together 
with yields A, € EL, U U ©) and hence U By 
induction and recalling that =U, we conclude thar YUB_ UC 
Using C, it then follows that Ul «€ é. 

Proof of (b). The result follows from the observation that A «U = 
[A] UM = 

Proof of (c). Ser € = [C] UU and D=[D]U Then OD 
DJ) UU, Assume C U D € v(2l). This is equivalent to [CUD]UWev. 
Hence by B,, € @Dev. An application of the contrapositive of B, yields 
© evorD ev. Thus C or D € v(Ul). Now assume that E F € 
Then [F] UU €v and hence, by B,, [E]U U €v, that is E € vl). Clearly 

Dé vl) and hence v(U) is a grill. 

The analogues of B, and B, thus are also valid for contiguities. It is 
also clear that cC, follows from (a)(i) and (ii). The proof is completely 
analogous to that for (c). The analogue of C, holds for nearness structures. 
However we are not able to derive B, and B, from it, since in those axioms 
we may be dealing with infinite families i and 8. The axioms B, and B, 
can be derived from the following: 

I: 

II: Let 8 be well ordered by indexing 8 = [B) by means of ordinal 
numbers and set 8. = [B;: i<j}. Then 8, UC ev Vi< B US 
provided either B > € or © = U OB for some U ¢ v. 

The proof resembles the proof of (a) but is by transfinite induction. 

Finally, note that if Il is a proximity and [A, B] € II then II([A, B]) = 
[A, B]. It follows that II@l) is not always a grill. 


Definition 2.5. For a nearness v on X we define 


M. S. GAGRAT AND W. J. THRON 
€, = (U: Wev, |U| < Ve v, = 2], 
c (A) = Le: [be] Ale 


For a contiguity € on X we have 
Ne = QU: We |U! = 2], cg(A) = Lx: A] 


If Il is a proximity on X we define c_(A) = [x: [x], A] € M1. 
The following results are immediate. 


Theorem 2.2. The family €,, is @ contiguity on X. Il, and I, are 
proximities on X, The functions c,, Ces and Cy are Cech closure operators 


on X, Finally, ll, = 

Definition 2.6. A proximity (contiguity, nearness) is called a LO- 
proximity (contiguity, nearness) if it satisfies the additional condition: 

Definition 2.7. A proximity (contiguity, nearness) A is called separated 
if it satisfies the additional condition [Ix], [y]] «A = x = y. 

A LO-nearness induces a LO-contiguity, which in turn induces a LO- 
proximity. However a non-LO-nearness may induce a LO-contiguity, and a 
non-LO-contiguity may induce a LO-proximity. This is illustrated by 
Examples 2.2 and 2.3 below. 

It is well known that the closure operator induced by a LO-proximity 
(and hence by any LO-structure) is a Kuratowski closure operator. 

Definition 2.8. Let A be a proximity, or contiguity, or nearness on X, 
then a family & C 8(X) is called A-compatible if B Cc U (and |B = 2, or 
|B| < Xo, if appropriate) implies B €A. The family W is called A-closed if 
[A] USB €A, for all 8 (and |B| = 1, or |B] < as appropriate), implies 
A IfA is a nearness then a family is A-closed iff Cc 

A A-compatible grill is called a A-clan, Finally, a A-closed A-clan is 
called a A-cluster, 

The next result was proved for separated LO-contiguities by Terwiili- 
ger [17]; it is also, in a disguised form, asserted by Herrlich [6] for LO- 
nearness structures. 


Theorem 2.3. Let \ be a contiguity or a nearness on X. Then every 


maximal \-compatible family % is a grill and hence a maximal \-clan on X, 


Proof. Except for the ‘union property’’ of % the proof is straightfor- 
ward. We shall consider the case where A is a contiguity. For nearness 
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structures the argument is somewhat simpler. Set a = [B: Bc UW, |B) < Xo]. 


Let A U Be YU, Then for all B € awe have [A UB] UB EX. Now either 
[A] U8 €A for all B €a, or [B] UB EA for all 8 € a, or there exist families 
8, and B, in such that [A] U8, and [B] U 8, Then by (a) (ii) of 
Theorem 2.1 ({A] U U8,)= © However > [A UB] U 
U and 8, U 8, €a. Thus [AU B]u U B,) €X. This contra- 
dicts (a)(i) of Theorem 2.1. Hence either [A] UY or [B] U Wl is a A-com- 
patible family. It follows from the maximality of WU that A € WU or B € U. 


Theorem 2.4. Let \ be a proximity, or a contiguity, or a nearness, Then 
every \-cluster is a maximal d-clan and a maximal -compatible family, 


Theorem 2.5. Let be a contiguity, or a nearness, Then every maximal 
A-compatible family is a \-cluster. 


Proof. Since every maximal A-compatible family 2! is a A-clan by Theo- 
rem 2.3, it suffices to show that [A] U8 €A for all BC @ with the appro- 
priate cardinality restriction implies A € %. This clearly follows from the 
maximality of 2 as a A-compatible family. 


Theorem 2.6. If A is a proximity or contiguity then every \-compatible 
family is contained in a maximal -compatible family, 


For a contiguity € it now follows from Theorems 2.3 and 2.6 that every 
&-compatible family is contained in a maximal &clan. Hence all contigu- 
ities are clan generated. 

Using Theorem 2.7 it is easy to construct examples of nearness struc 
tures Vv, where not ali v-compatible families are contained in maximal 
families. 

Example 2.1. Let |B|> Leta 
closure operator c be defined on X by requiring that X, A, B and all finite 
sets form a subbase for the closed sets of the space. Define a proximity I" 
on X by: [C, D] € II* iff c(C) A c(D) 4 or both C and D are infinite. Then 


B= [c: CC X, |C|> Xp] 
=UIU: is a nonprincipal ultrafilter on X] 


is a maximal II*-clan. The maximal II*-compatible families containing & are 
&, =(D: a €D, UB and &, =[D: b € D, UB where a€éA, 
b € B. It is also clear that 3% is not a I*-cluster. Even for an EF-proximity 
II there may be maximal I]-compatible families which are not clusters. An 


example can be constructed by considering the three sides of a triangle in the plane. 
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We can summarize the results obtained above, by considering the follow- 
ing statements: 

(A) A clusters are maximal A-clans and maximal A-compatible families, 

(B) maximal A-compatible families are grills, 

(C) maximal A-compatible families are A-clusters, 

(D) A-compatible families are contained in maximal A-compatible fami- 
lies, 

(E) maximal A-clans are maximal A-compatible families. 


The following table now gives the desired information: 


Cc E 


proximity Ex. 2.1 Ex. 2.1 


contiguity yes yes 


neamess open open 


Theorem 2.7. Let [G: i € I] be a family of grills on X with the property 
that for every x € X there exists ani such that |x] € 6. Then v defined 
by iff lc g., for some i € I, is a basic nearness on X, 


Proof. We show that B, holds, the other properties are easily seen 
to be true. If U ¢v then for every i €/ there exists a set A, € I such 
that A, Similarly ¢ v implies the existence of sets B such 
that B, Now assume that © 8 Then there exists a j such 


that OBc In particular A, UB. must be in oF but this is a contra- 


diction since neither A; nor B. belongs to 6G. 

The following stronger theorem holds for contiguities. 

Theorem 2.8. Let [G,: i € I] be a family of grills on X satisfying the 
two conditions 

(a) for every x € X there exists a 6G. such that [x] € Gi, 

(b) i4j—G,¢6. 
Then € defined by € iff U for some i and < is a basic con- 
tiguity on X, Every contiguity € on X is generated by the family of all its 
maximal &=clans, 


Proof. The proof of the first part is completely analogous to the proof 
of Theorem 2.7. The second part follows from Theorems 2.3 and 2.6. 


= 
A B 
° 
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Theorem 2.8 can be thought of as a representation theorem for conti- 
guity structures since it asserts that all such structures are of the simple 
type described there. 


Theorem 2.9. Let A be a proximity, or contiguity, or nearness on X, 
Let SC X. Define As = [U: Ler AP(RS))], then As is a proximity, or 
contiguity, or nearness onS, X, is called the structure induced by X on S, 
Finally, if X is a LO-structure then so is X.. 


Definition 2.9. If A is a proximity, or contiguity, or nearness on X then 
the pair (X, A) is called a proximity space, or a contiguity space or a near- 
ness space, 

Definition 2.10. A mapping /: (X, A) — (Y, 7) is called a proximity 
map, or a contiguity map, or a near map if UevA = (f(A): A eUlen. The 
expressions p-continuous, c-continuous and n-continuous are also used. 

Definition 2.11. A structure A will be said to be Jarger that a structure 
\’ if A, considered as a collection of families of sets, contains A’. 

We now turn to the discussion of some special nearness and contiguity 
structures and to some examples. 

Definition 2.12. Let € be a contiguity on X and let [GS : ie I) be the 
family of all maximal &-clans. By v(€) we shall denote the collection 


(Ul: We for some i € I]. 


[6¢] is a family of grills and satisfies the conditions of Theorem 2.7, 
hence () is anearness. Since every  €& is contained in a maximal &- 


clan it is true that ee) = &€. From this equality it also follows that for 


every contiguity € there is at least one nearness, namely v(€), which induces 
it. 


Theorem 2.10. Let v be a nearness which satisfies the condition: 
Usviff IBcU,|Bl< Bev. (That is: v is a “contigual nearness” 
as defined by Herrlich [6].) Then v= v(€,,), where &, is the contiguity 
defined in Definition 2.5. Moreover, v is clan generated, Finally, for any 


contiguity & the nearness v(€) is a contigual nearness, 


Proof. That v= v(€ ,,) can be seen as follows: Levitt VBcuU, 
Bev, ifflisa -compatible family, iff where oF is a maxi- 
mal €, -clan, iff € v(€,,). Clearly all are clan generated. The last 
assertion can be proved by substituting v(€) for v in the first argument and 
recalling that = 
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Definition 2.13. Let A be a proximity or a contiguity or a nearness on 
X. AA-clan on X will be called a A-bunch iff b(G) = [A: c,(A) € GJ] = 6, 


Theorem 2.11. If A is @ LO-structure on X then every maximal )-clan 
on X is a \-bunch, 


Proof. This is an extension of a theorem proved for proximities by 
Thron [19]. 

Now let (X, Il) be given and consider any nearness structure v such 
that II, =TII. Let i € I] be the collection of all maximal II-clans. If 
€v then is € ,-compatible and hence there exists a maximal -compat- 
ible family which is a €,,-clan, such that CH. § is a Il-clan and hence 
is contained in one of the maximal Il-clans en. It is thus easy to see 
that there is a largest nearness vl, which induces I]. It is defined as fol- 
lows: vl = (Ul; Uc en for some i € I]. It is slightly easier to show that 
[U: < Ro, Uc en for some i € I] is the largest’contiguity which 
induces II. 

If [A, B] € Il there are in general several ways (but always at least 
one) of choosing ultrafilters uf and “ so that A € ue, Be ns and G, B= 
08 U u4 is all-clan. (This is shown in [19].) Any collection [: 

i G,B for some [A, B] € Il] is a clan generated nearness. That these 
nearness structures are ‘‘small’’ in a very real sense follows from the fact 
that they are generated by grills which are as small as possible, at least for 
ANB=2. If ANB 2D Ix] one could agree to choose = ns = U(x) = 


[C: x € C] and thus, in that case, also have G,B = U(x) as small as pos- 


sible. Nevertheless, it will not in general be the case that these near struc- 
tures are minimal with respect to inducing II and being clan generated. It 
is conceivable that certain grills GAB could be deleted from the family of 
grills defining one of these structures without affecting the proximity in- 
duced by the structure. This is always the case if [A, B]C Gap for a 
pair [C, D] e Il and B # If minimal clan generated nearness 
Structures compatible with a given proximity I] do indeed exist, they must 
be of the type discussed here. 

That for certain proximities II there does not exist a least near struc- 
ture compatible with II has just been shown by NjAstad [15]. 

The situation becomes much simpler for contiguities. For them we 
have the theorem: 


Theorem 2.12. Let Il be a given proximity then 
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&, = (8: < x,, B=8, 


is the least contiguity compatible with Il. &, can also be characterized as 
&, = (8: |B] < BC G4 for some [A, Bell), 


Eq is independent of the choice of the family (6, B: [A, B] ell], provided 
that for each [A, B] € Il there is at least one Ge p containing [A, B]. 


Proof. That the two characterizations define the same collection is 
easy to check. That the collection is a contiguity compatible with II can 
be deduced from the second characterization. Clearly all 8B with [N3,. 

NM 8.) € Il must be in every € compatible with II. It follows that €y is the 
least contiguity compatible with II. 

If II is a LO-proximity then, by Theorem 2.11, the @" are II bunches 
so that we have in particular (A ,): jeJic gn [A It 
follows that vand €" are LO-structures and hence the largest LO-struc- 
tures inducing II. 

Example 2.2. Let X be the Euclidean plane and Il be the proximity in- 
duced by the usual metric on X. Then (X, Il) is a LO-proximity space, but 
& (as defined above) is not a LO-contiguity. To see this let A and B be 
two disjoint closed sets with A €II(B). Let 


A,NA, =f, 
cy(B,)=cy(B,)=B, B,NB, 


No union of two ultrafilters can contain the four disjoint sets A A,, Bis 
B, hence [A,, A,, B,, B,1 however [eq(A,), 
le one 
**Small’’ LO-structures compatible with a given LO-proximity II can be 
induced by bunches of the form b(G 4 p)- In particular 
= [B: |B] < B for some [A, Ble TI] 


is the least LO-contiguity compatible with II. As before, it can be shown 


that éh is independent of the choice of the S, ,- & can also be de- 


scribed as 


1 m 


(Neg Meg M1. 
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The existence of "and fe was known to Terwilliger [17]. 

Example 2.3. Let X be an infinite set and define U(x) = [A: x € A], 
%=U[U: U is a nonprincipal ultrafilter]. Define the contiguity € on X as 
follows: « € iff |U| < and Uc Ue) U ® for some x € X. This conti- 
guity induces the minimum T ,-topology on X and is a LO-contiguity. Now 
define a nearness v by v iff Uc U(x) UU, where U,,..., U, 
are arbitrary nonprincipal ultrafilters on X. Clearly, €,=€. vis not a LO- 
nearness, since for a LO-nearness every family of infinite sets would have 
to be near. This is so because in a minimum T ,-space the closures of all 
these sets would be equal to X. 

Example 2.4. Let X =U[A,: k= 1, 2,.. -], where |A,| is infinite for 
each k and all A, are disjoint. Define a contiguity ¢ on X by Ue iff 
&l| < &, and UC U(x), for some x, or UCB, (U(x) and B are as defined in 
the preceding example.) Then il, is the proximity in which two sets are 
close iff they intersect or they are both infinite. This is the largest LO- 
proximity on X compatible with the discrete topology. Denote by S any 
finite union of nonprincipal ultrafilters and by y the collection of all of 
these grills. Then ¢ can also be characterized by U € ¢ iff |U|<&, and 
Yc U(x), for some x, or Uc G for some G € y- 

For each k let &, be a nonprincipal ultrafilter containing A,. Now 
define a nearness p on X as follows: U € p iff UC U(x) for some x € X, or 


Uc G, for some y, or U or =§,. Clearly 


¢. For further reference note that = k=1, 2,...1C 91 


= [A,, het. that 9, U 9, ¢ but that every finite subset 
of it is in €. We shall use this example in $3 to show that not all II” can 
be generated by contigual nearness structures (€). 


The final three results are of importance in $3. 


Theorem 2.13. Let v be a nearness on X and let Lev. If v@l) ev 
then v(2l) is a v-cluster, 


Theorem 2.14. If \ is a LO-proximity or a LO-contiguity or a LO- 
nearness on X then, for every x € X, A(x) is a A-cluster, 


Theorem 2.15. Let v be a nearness on X and let Xl, B, © be families of 
subsets of X such that gv, BUS gv. ThenQ@OB)uE ¢v. 


Proof. Define ©*= [A: 3B €€, A DB]. Then MU C* ¢vandB VU 
©*¢v. It follows from B, that 
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C*)O BvC*)¢v, 


Now 


T= (UDB) OC*)vU BOE") u(C*O C*), 
The last three families are all contained in ©* since ©* is a stack. We thus 
obtain Dc B) U C* and hence OB) UC* gv. Ip view of condition 
B, this is true iff Ql @ 


3. Proximities defined in terms of near structures. We begin this section 
by reviewing some facts about extensions of topological spaces. We make 
certain modifications, such as the transition to dual traces, and extend con- 
cepts, where feasible, to closure spaces (see Cech [4]). 

The triple (¢; (Y, @)) is an extension of the closure space (X, c) if 
(Y, d) is a closure space and ¢ is a homeomorphism from (X, c) to (A(X), 
d'), where @'(A) = d(A) N G(X), A C A(X), and if d(f(X))= Y. That is 
(X, c) is densely embedded in (Y, 2). Two extensions (¢, (Y, @)) and 
i", cyt, d‘y) are equivalent if there exists a homeomorphism w from (Y, @) 
onto cyt, d') such that f °¢ = ¢! on X. If there is no danger of confusion 
we may sometimes refer to (Y, d) as an extension of (X, c). 

For each y € Y define 


= ny, (Y, d)) = [A: AC X, y 
the dual trace of the point y with respect to the extension (¢, (Y, @)). The 


set [r(y): y € Y] is called the dual trace system of the extension. 
We note that 7(y) is a grill on X and hence its dual 


D(dy)) =[B: X~ B ¢ =([B: BN VAE 


is a filter on X. If d is a Kuratowski closure operator then 7(y) is a c-grill 
(a grill G is a c-grill iff c(A) € G = A € G) and D(r(y)) is an open filter for 
all y € Y and [D(r(y)): y € Y] is the trace system of the extension (¢; (Y, 
d)). A simple translation of the usual statement in terms of trace systems 
gives the following: 

Let (X, c) be a T topological space (this insures that r((*,)) 
r(P(x,)) iff x, € X) and let X" be a collection of c-grills on X 
containing all P() = [A: x €c(A)]. Define 


A*-[@: Ge x* Ae §], 
P_(), and 
d*(a)=()\[A*: a C A*] for all a C X*. 
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Then d* is a Kuratowski closure operator and (¢, (x, d *y) is equivalent 
to the principal extension of (X, c) with respect to the dual trace system 
x* (see Thron [18]). The dual trace system of this extension is indeed -. 
More specifically it is true, for every G € X* , that 7(3) = G 

These (or equivalent) extensions have a number of other names. Bana- 
schewski [1] calls them the strict extensions with respect to X *, Lodato 


[11] in a more special context obtains the same extensions and Gagrat and 


Naimpally [5] refer to the topology generated hy @ * as the absorption topology 
on X*, Wagner [21] calls these extensions filter spaces, 

We next observe that 

d*(g(A)) = [B*: B*] = A* = (c(A))* = 
and that in view of the definition of d* the family [A*: A* = d*(¢(A)), 
A C X] forms a base for the closed sets of (X",@*). 

An extension (¢, (Y, @)), where the closure operator d is determined by 
d(B) =f A C X, d(f(A)) > B] (this is equivalent to saying that the 
sets d(f(“)) form a base for the closed sets of the space) is called by 
Ivanova and Ivanov [8] a regular extension. Thus the principal extension 
is a regular extension. 

Moreover, since the dual trace system (and hence the trace system) of 
an extension determines the family ‘[d(¢(A)): A C X], and since knowledge 
of this family determines the dual trace system, there is exactly one (up to 
equivalent ones) regular extension of a given space for a given dual trace 
system, namely the principal extension. It is also clear that for any T 9- 
topological extension (¢; (X*, d)) of (X, c) with dual trace system X*, con- 
sisting of cegrills, the relation d(a) C d*(a), a C X*, holds. 

We now turn to the description of a method to define proximity exten- 
sions of proximity spaces. Let (X, Il) be a LO-proximity space and let v 
be a LO-nearness on X which satisfies I, = fl. Define 


xX” =[U: U is a v-clan] [Ax): xe XI, 

AY =[U; Ue xX”, Ae for ACX, 

Ae U for Uc P(X). 
We then let II” be the collection of sets [a, B],a CX”, BCX” determined 
as follows: [a, B] € Il” iff (Na) U (NB) € v. Note that we do not require 


X” to contain all yv-clans. We do however require that it contain all v-clans 
of the form v(x). 


Theorem 3.1. (X”, Il”) as defined above is a proximity space, 
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Proof. If a NBD then (Na) vu (Npyc Since Uev, la, Ble 
Il” follows. If a> B then (NB) U Ny) ev and Nac 
Hence (Ma) Ny) €vandae lly). Finally, a I’(y) and B¢ Il” (y) 
implies (Na) (Ny) ¢ v and (NB) Ny) An application of Theo- 
rem 2.15 yields (Na) @ (NB))U Ny) év. Now Na and MB are 
stacks. It follows that (Na) @ (Np) B). Thus we obtain 
(Na vp) ¢v. 


Theorem 3.2. Define $: (X, Il) — (X”, II”) by d(x) = u(x), for all 
x €X, and letc” =cyv. Then 


(A)) = AYN d(x) = A(X) 
for allA C X, and 
Cc (B) iff A’ A(X) Cc BY’ d(X). 


Proof. v(x) € $(cy(A)) iff x € (A) that is iff [Ix], A] e since 
I], =. Hence u(x) € iff A € v(x) iff € A” N G(X). Next, 
u(x) € cA”) iff u(x) U[A] Ev. This is the case, since v(x) is a v-cluster 
by Theorem 2.14, iff A € v(x) €A” Nd(X). Though ¢ may not be one-to- 
one, it is true that f(x) = f(x’) iff v(x) = v(x") iff x and x’ are contained in 
the same closures. 


Theorem 3.3. (X, 11) (X”, II”) is @ proximity mapping and (X) 
is dense in (X”, c”). Moreover, (X, Cy) is a closed 
mapping. If Il is a separated proximity then ¢ is one-to-one and provides 
a proximal embedding of (X, Il) into (X”, 11”). Thus (J, (X”,II”)) is 
proximity extension of (X, Il). 


Proof. We first observe that for A CX, C if [lal ev 
for alla € A iff AC c,(C). Now [p(A), 
(Nd(B)) fv. Recalling that v is a LO-nearness, we then have [A]u 
[B] ¢ v and thus finally [A, B] I]. Hence ¢ is a proximity mapping. The 
remaining assertions of the theorem are easy to verify. 

The properties of the space (X ”, 11”) depend very much on the choice 
of X”. Il will continue to be a LO-proximity and v a LO-nearness on X. 
Our first result is: 


Theorem 3.4. The proximity Il” is separated iff for 6. G,€ i 
6, 6, it is true that 6, U 6, év. 


M. S. GAGRAT AND W. J. THRON 


Proof. It follows from the definition of I” that (G1, (6) e Il” iff 
6, ev. 

Theorem 3.5. The trace of the point G € X” with respect to the exten- 
sion (X”, of (X, Cy) is 7G) = (GB). If X” is such that all 
are veclans then Il” is separated iff u(G,) = = 6, 6.. If one 
thinks of r as a function from X” to € X”] defined by r(G) = 
then the condition for Il” to be separated (provided all v(G) are veclans) 
becomes the one-to-one behavior of r. 


Proof. = [A: c%((A))] = [A: [A] UG ev] = 1G). If there exist 
€ X” such that 6, and u(G,)= v(G,), then € u(G,) and, 
since all v(G) are assumed to be v-clans, 6, U 6, €v so that II” is not 
separated. If II” is not separated there exist ©, 4G, such that 8, VU 
6, €v. It follows that 6, u(G,) which if € v implies v(G,). 
By an analogous argument we obtain v(G,) and hence v(G,). 


Theorem 3.6. If all @ € X” are maximal v-compatible families, then 
= r(G) for all G@ Further, Il” is a LO-proximity on X” the closure 
operator c” is a Kuratowski operator, and (g, (X”, c”)) is the principal 


extension of (X, Cy) with respect to the dual trace system a 


Proof. If is maximal compatible then = v(G) = 7(G). Ler ac X” 
then 


c'(a) = Na = ie llc 


Assume [a, ¢ then = [A =faand $= = Np is such that 
UUB¢v. However c”(a)C and c’(B)C and hence 


[e%(a), Thus Il” is a LO-proximity and the closure operator 
induced by it is a Kuratowski operator. 


Theorem 3.7. Let (X”, II”) be such that 

(a) for allG €X”, 

(b) 6, 4G, (G,)4A G, € x”, 

(c) c” is a Kuratowski closure operator on X”. 
Then 1: (X", d*), where = v(G), is a homeomorphism, and 
r(v(x)) = v(x). Thus (h, (X”, ¢”)) is equivalent to the principal extension 
with respect to its dual trace system 6 If only (a) and 
(b) hold one has r(c”(a)) > d* (7(a)). 


NEARNESS STRUCTURES, PROXIMITY EXTENSIONS 119 


Proof. 1(G) ev implies that v(G) are maximal vecompatible hence the 
v(G) are also cegrills. The maximality of the »(G) together with the fact 
that v(v(x)) = v(x) and condition (b) insures that (X, ¢q) is a T)-space. 

(As a matter of fact it is a T ,~space since it is generated by a proximity.) 
This suffices for the existence of the principal extension (¢, ae d*)) with 
dual trace system @ J. We recall thar 


d*(p) BCA*], BC X*, 
where A* = [1(G): A € 1(8)]. Thus for ac X” 
Xc%a)) = 13: Na =[4) 
Na =[A Jc 
= A,eX@)]: NIG: Ge al] 
= A, NIG: Ge al] 
> NLAF: Ae NIA): Ge all 
= Mla": A,€ NAG): AG) € 
= Ha) C A‘ = d'(xa)). 


If c” is Kuratowski then we must have 7(c”(a)) C d*(r(a)). Combining 
these two inclusion relationships we conclude that 7 is a homeomorphism. 
That 7(v(x)) = v(x) follows from the fact, already noted before, that v(v(x)) = 
v(x). 

It would be desirable to have a better sufficient condition for c” to be 
a Kuratowski closure operator than that contained in Theorem 3.6. This 
however appears to be a difficult problem. 

Partly motivated by Lodato’s [11] constructions and partly by that em- 
ployed in the construction of the principal extension we are led to the fol- 
lowing definition. 

Let (X, Il) be a LO-proximity space and let xt be a family of Il- 
bunches on X such that xt'5 x X]. Define d(x) = I(x), al = 

A cS], and d'(a)= NMlAt: aC At], a CX". We call d! the ab- 
sorption closure operator on xT, 

By standard arguments, using the fact that the 9 are grills, one shows 


that d' is a Kuratowski closure operator on xT, Moreover, @: (X, cq) 


(A(X), (xy) is a homeomorphism, since the are Cy-grills, provided Il 


is separated. 
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The fact that the § are Il-compatible begins to play an important role 


only if XT contains enough © so that [A, B] € Il implies the existence of an 
He XT such that A, Be. In this case 


[A, Bh ell iff 4 


It is of interest to compare d' with c” in the case X” = xT, We have 
the following result. 


Theorem 3.8. Let (X, II) be given and let X” = x! be a family of v- 
bunches (and hence M-bunches). Then c= d' iff all @ € X” are maximal 
v-compatible families. 


Proof. If all are maximal then by Theorem 3.6 c” = d', 
then in particular = d'(A”) = However, if is not a 
maximal v=compatible family then there exists an A C X such that A ¢ @ but [A] U 
ev. It follows that €c’(A”) but @ 4 A” and hence c” 4 

Let € be a LO-contiguity on X. For a family X® of &-clans one can, 
in analogy to the definition of II”, define née by la, Ble Te iff (Na) v 
is a compatible family. However, = (xs), ), where 
v(E) is the nearness defined in Definition 2.12. First, observe that the 
W€)-clans are exactly the &-clans, hence any X® is an X“S), and con- 
versely. Next, let [a, B] eM”. This is equivalent to © = (Na) u 
(NB) € v(S), which is true iff © is v(€)-compatible. This is the same as 
€ is &-compatible, which is the same as [a, B] € If. Thus nothing is lost 
by not considering separately extension spaces of the form (X f, IIS). 

The question remains whether anything is gained by considering exten- 
sion spaces generated by nearness structures. The answer is in the affirma- 
tive as the following example shows: 

Let X, ¢; pts etc. be defined as in Example 2.4. Set 


x? = [p(x): x € Uy 9,1. 
Il” and II are distinct, since é Il” but ($,]] ell’. m4 


could not be obtained from a smaller contiguity Z’ since for no smaller con- 
tiguity will all grills in X$ be ¢'-clans. 


4, Comparison of extensions (X”, II”) with arbitrary extensions. Let 
(X, II) be a LO-proximity space and let (i, (Y, II*)), where i is the identity 
mapping, be an arbitrary proximity extension of (X, Il). The question we 
propose to investigate in this section is: how close can we come to (Y; II") 
by a suitable choice of v and X”? It will be convenient to impose on II* 
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a restriction which is slightly weaker then the LO-restriction. 
Definition 4.1. Let (X, A) be a nearness or contiguity or proximity 
space and let SC X. Then A is said to be a LO/S-structure iff for all 
A.C S 
[c(A): ie NEA [Az ie lea, 


Theorem 4.1. Let (4, (Y, II*)) be a proximity extension of a proximity 
space (X, Il) and let * be a LO/f(X) nearness or contiguity or proximity 
on Y such that =I". Define on X by iff UC P(X) and [p(A): 

A eU]er*. Then every ry) is a d-clan on X. If in addition C isa 


Kuratowski closure operator then the r(y) are \-bunches (and hence a fore 


tiori c)-grills). 


Proof. It was already noted in $3 that the r(y) are always grills on X. 
Since all elements of Ic, (P(A )): A € r(y)] have the point y in common, the 


family [c,,($(A)): A € Since H(A) C A(X) and is LO/A(X) it 
follows that [¢(A): A €7(y)] €A” and hence r(y) € A. 
The function ¢: (X, c,)- (Y, Cy») is continuous; hence f(c,(A yc 


c,«(P(A)). If we now assume that c,, is a Kuratowski operator then 


Thus y € implies y € so that from ¢,(A) € r(y) 
follows A €r(y). Hence if Cys is a Kuratowski operator, then each r(y) is 
a A-bunch. 


An immediate consequence of Theorem 4.1 is 


Theorem 4.2. If in (6, (X”, 11” )) II” is LO/G(X)-proximity then for 
all @ € X”, = are Il-clans. 


Unfortunately, the behavior of the dual trace system of a proximity 
extension with respect to maximality of its members is not as nice as one 
might wish. This is illustrated by the following two examples. 

Example 4.1. Let Y= A, >A, >A; >... where MIA,: k= 1, 2,...]= 


@. Further let X C Y be such that \(A, vA, ii) A X| = © and that 
(A, ~ ~X)4@ for all k> 1. Now let k(B) be the smallest 
natural number & such that for |B] = 0, B~ Ax B) is infinite. The prox- 


imity II on Y is then defined as follows: [A, B] Il iff Cy (A) Cp (B) #D, 


where for finite sets B, c,(B)= B. If |B| = © then c,(B)= BY Aicay-1"° 
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Then II is a separated LO-proximity on Y and (i, (Y, Il)) has as dual traces, 
with respect to (X, fl,.), the following: for y, € (A, ~ A,, pavn X) 


Thus, clearly, (Y p41) > r(y,) so that no r(y,) is maximal. 

Example 4.2. Let Y=A,u A,, A, NA =f, k# m, k= 1, 2, 3; 
m= 1, 2, 3. UA) UA, A =A, 9X, = Let 
%, be a nonprincipal ultrafilter on Y containing A and define 

92 =[B: BC Z, |B NC| 
It is a grill on Z. Now define c* on Y by 


c*(B) = BUUIA,: |A, 9 =~) 


and let II* be the least separated LO-proximity on Y for which Cy» = e*. 


Then v*, is the least LO/X-nearness on Y which induces Il", where v* is 

defined by UC PY) is in v* iff UC Uy) yeA,or UB, 

AC Y,BC YX both infinite, or UC U The proximity v induced 
m 


k 
by v* on X can then be described as follows: UW ev iff UC PX) and =<) 


some For y €A, Al we have 7(y) = 
k 


These 7(y) are thus not maximal as v-clans. We also observe that 


which is a II,-clan, but is not v-compatible. 


For purposes of comparison it seems desirable to choose X” to be the 
dual trace system of (Y, TI"). However, since the dual trace system of 
(X”, 11”) is [(G): B € X”] it becomes clear that our choice can be com- 
pletely successful only if the r(y) = G = v(G), that is only if the r(y) are all 
maximal v-clans. The two preceding examples show that this is not always 
attainable. 

We now show that with the above choice of X, and with a suitable 
selection of v, the natural mapping from (Y, II") to (X”, II”) is at least a 
proximity mapping. 


Theorem 4.3. Let (i, (Y, II")) be an arbitrary proximity extension of 
the LO-proximity space (X, Il), Let v* be a LO/X-nearness on Y such that 
Ils Finally, let R(P(X)). Set X”= [r(y): ye Y] and define 


{: (Y, II*) > (X”, II”) by f(y) = r(y) for all y €Y. Then f is a proximity mapping. 


Xy,)=[B: BCX, |B~A,,,| =o 
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Proof. Clearly II, = Il and r(y) is a v-clan on X (Theorem 4.1). We 
also have 7(x) = u(x), for all x € X, and hence x" = [r(y): ye Y] isa per- 
missible choice. 

Let D C X; then 


{~\D”) ye Y, = ly: ye Y, ye = Cyx(D). 


Now let a, 8 C X” be such that [a, BJ) #11”. Then (Na) vu (NB) é v. 

Set A = f~1(a), B= and MB = 3B. Then BC BX) and 
Similarly BC Bie Bl. if [A, B] € then [A, B] € and hence 

A,€ Wu [c+(B ): B,€ Bl 


Since v* is a LO/X-nearness and A, C X, B,C X, it follows that YuBerv*, 


Since UU BC BX) it is also true that UB ev. This is a contradiction 
and hence [A, B] ¢ II". 

The content of the preceding theorem is meaningful only if for any 
proximity II* on Y, which induces a LO-proximity I] on X, there exists a 


LO/X-nearness v* on Y such that II , = II". This, though not quite trivial, 
Vv 
is indeed the case. 


Theorem 4.4. Let X C Y and let (Y, II") be a proximity space such 
that the proximity induced by II* on X is a LO -proximity. Then there exists 
a LO/X-nearness v* such that ll , =I". 

Vv 


Proof. For every pair of sets [C, D] € II* we determine a pair a RE 
of ultrafilters on Y such that C € e. De . and BP U BS is a II*-clan. 
Next, for any grill $ on Y define 


= [B: JAC X, BDA, 


It is then easy to verify that b,(Q) is a grill on Y, and that v* defined by 
v* iff 


Uci*(y), some ye Y, 


Uc U =. some [C, D] 


by U Bo), some [C, D] 
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— * 
is a LO/X-nearness on Y and satisfies the condition I] , =I. 
v 


Theorem 4.5. The map {, as defined in Theorem 4,3, is one-to-one iff 
(1D y, y,€Y, implies the existence of AC X such that either 


Yo or Y> € As holds, 


Proof. Condition (I) is exactly what is needed to insure that r(y,) = 
r(y,) and hence that /(y) =7(y) is one-to-one. The condition is mentioned 
by Ivanov [9] as a possible additional requirement for an extension to be 


regular. Note that (I) implies but is stronger than the condition that II" is 
separated. 


Theorem 4.6. The function (Y, II") + (X”, I”) provides a proxi- 
mally isomorphic mapping iff condition (1) of Theorem 4,5 and: (J) For A, 
BC Y,[A, B] ¢Il* = the existence of collections U, BC $(X) such that 
Ac ;): W,Bc B, € Bl and U US ¢ v, are satis- 
fied, Here {, v and X” are defined as in Theorem 4.3. Condition (J) implies 
that all r(y) are maximal v-compatible families, 


Proof. Condition (I) is necessary and sufficient for | to exist and 
(J) is necessary and sufficient for ii to be a proximity map. The condi- 
tions of Theorem 4.3, which are assumed to be satisfied, insure that / is a 
proximity map. Finally, A ¢r(y) implies [A, [y]] ¢ II” and hence by (J), and 
if we assume that A C X, it follows that there exists a family BC r(y)C 
¥%(X) such that [A] UB ¢ v, that is r(y) is a maximal v-compatible family. 


Theorem 4.7. A sufficient condition for all r(y) of (i, (Y, II")) to be 
maximal vecompatible families is that for y € Y and EC X E ¢r(y)= iN, 
such that [E, Ny] 


Proof. Since Nn X=D£Q we have that E ¢r(y) implies the exis- 
tence of DC X such that [E, D] ¢ Il. Hence every 7(y) is a maximal II- 
compatible family and, a fortiori, maximal v-compatible. A sufficient con- 
dition for these conditions to be satisfied is if II* is an RH-proximity (see 
[19]) and hence certainly if II” is an EF -proximity. 

The conditions appearing in the results above all depend on II* as well 
as on the “‘position’’ (a sort of “‘super density’’) of X in Y. The stronger 
the assumptions on II" the less important will be the requirements on the 
“‘position’’ of X in Y. Conversely, with relatively weak assumptions on nI* 
the requirements on X become critical. 
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ABSTRACT. In this paper it is shown that each semigroup which is 
a matrix of commutative cancellative semigroups has a ‘quotient semis 
group’”’ which is a completely simple semigroup with abelian maximal 
subgroups. This result is proved by explicitly constructing the quotient 
semigroup. The paper also gives necessary and sufficient conditions for 
a semigroup of the type being considered in the paper to be isomorphic to 
a Rees matrix semigroup over a commutative cancellative semigroup. 
Several special cases and examples are also briefly discussed. 


The study of the semigroups in the title was initiated by Petrich [7] in 
connection with commutative separative semigroups. It was conjectured in 
that paper that matrices of commutative cancellative semigroups can be em- 
bedded into Rees matrix semigroups over abelian groups. This paper answers 
the conjecture affirmatively. We also study the embedding and use it to 
characterize several special cases of matrices of commutative cancellative 
semigroups. 


0. Preliminaries and summary. We use S to represent a semigroup. If 
there is a congruence p on S for which S/p is a rectangular band whose 
classes are all commutative cancellative semigroups, then we say S is a 
matrix of commutative cancellative semigroups. Since a rectangular band 
may be considered as | x A, the product of a left and right zero semigroup 
respectively, we will write S = Uy S54 for a matrix of commutative can- 


cellative semigroups, whose classes are the S,,. In case the rectangular 
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band above is just A, a right zero semigroup, we define a right zero union 
of commutative cancellative semigroups and write S = U,s ,» analogously. 

A second concept we will make extensive use of is the Rees matrix 
semigroup. We denote such a semigroup by S = Md, G, A; P), where I and A 
are nonempty sets, G is a group, and P maps A x I into G. The functional 
value P(A, i) is denoted by ~,;. Elements of S are of the form (i, g, A) 
with i € I, g €G,A €A and multiplication is given by (i, g, A)(j, >, ») = 
(i, 8P, js 1). We call S the Rees matrix semigroup over the group G with 
sandwich matrix P, It is a well-known theorem in semigroup theory that a 
semigroup is completely simple if and only if it is isomorphic to a Rees 
matrix semigroup over some group. A completely simple semigroup is a 
simple semigroup which contains an idempotent ¢ which has the property 
that if f is another idempotent for which / = ef = fe, we must have e = /. 
Any other concepts not defined in the text may be found in Petrich [6] or 
Clifford and Preston [3]. 

The main result of $1 is that matrices of commutative cancellative 
semigroups are precisely subsemigroups of Rees matrix semigroups over 
abelian groups. We do this by constructing a special Rees matrix semi- 
group, called the quotient Rees matrix semigroup, into which a given matrix 
of commutative cancellative semigroups can be embedded. A characteriza- 
tion of a special type of matrix of commutative cancellative semigroups is 
given. 


$2 contains the justification for calling the particular Rees matrix 


semigroups over abelian groups constructed in Sla quotient Rees matrix 
semigroup. This is given in a theorem which says that its quotient Rees 
matrix semigroup is the smallest into which a matrix of commutative can- 
cellative semigroups can be embedded. There are also several other results 
which give further information about the nature of the embedding. 

In $3 we use the results already obtained in $$1 and 2 to characterize 
Rees matrix semigroups over commutative cancellative semigroups, which 
generalize the notion of a Rees matrix semigroup over a group. We also 
consider a restricted family of Rees matrix semigroups over commutative 
cancellative semigroups. 

$4 contains a short discussion of several examples. These include 
free contents, prime quasi-uniserial semigroups and Ji-semigroups. 


1. The embedding. We start with several definitions which have been 
used to characterize matrices of commutative cancellative semigroups 
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and a lemma which is probably known. 


If for any a, b, c € S we have abc = bac, then we call S left commuta- 
tive. 


Lemma. If S = UsaS) is a right zero union of commutative cancellative 


semigroups, then S is left commutative. 


Proof. Let a, b,c € S, so that a€S,,b ES and c eS, for some 
A, € A. Since S iS a commutative semigroup, we compute (abc) (bc) = 
(bc) (abc) = b(c) (abc) = b(abc)c = (ba)(bc)c = (bac)(bc). Therefore we have 
abc = bac, by cancellation in S,,, as required. 

We need the following two definitions before we can present our first 
theorem. We define S to be weakly cancellative if for a, bs» x € S, ax = bx 
and xa = xb implies a = 6, A semigroup S is conditionally commutative if 
for a, b € S with ab = ba, then for any c € S we have ach = bca, 


Theorem 1. The following conditions on a semigroup S are equivalent: 
(i) S is a matrix of commutative cancellative semigroups. 
(ii) S is weakly cancellative and conditionally commutative. 
(iii) S can be embedded in a Rees matrix semigroup over an abelian 
group. 


Proof. As mentioned in the introduction, Petrich [7] has proved the 
equivalence of conditions (i) and (ii). Therefore we will start with S = 


VU, S ;,? 2 matrix of commutative cancellative semigroups, which is weakly 


cancellative and conditionally commutative. We will construct a Rees matrix 
semigroup, Q(S), over an abelian group into which S can be embedded. 

To start the construction, we fix 1 € I, 1 € A, an element @ € S,, and 
let G be the quotient group over S 11? Written in the natural way as quotients 
of elements in S,,. We also define a mapping P from A x lL into G by 


2 2 
a‘sta 
for some seUS;,, reUS,,. 


asa‘ta 
To show that P is single valued we choose another u € Us. and v € 
and will show 


asta auva 


asa"ta aua*va 


We obtain the following string of equalities: 


| 

| 

| 

| 
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(asta)(aua)ava) = (asta)(ava)(aua) = (asta? (va? (ua) 
= (by commutativity in 
= (asva)(ata)(aua) = (asva)(aua)(ata) = (asva)(au)(a? ta) 
= (au)(asva)(a*ta) (y left commutativity in U s,,) 
= (au)(as)va>ta = (as)au)va>ta (by commutativity in S,,) 
= (asauva)(a?ta) = (by left commutativity in U Sty) 
= (auva)asa\ata). 


Thus we have established that P is single valued. 
Therefore QS) = Mc, G, A; P) is a Rees matrix semigroup over an 
abelian group. Define a function ¢. on S by: 


= (i, aba/a’, for b 


It is immediate that ¢, is a function from S into QO (S). Let b, ¢ € S with 
be and c € Sut For these elements, 


ab . aba aca 
a a a a 


2 


. aba a*bca? )- abca 


(aba\laca) gq 2 r) 


using the definition of P,;° Hence ?, is a homomorphism. 

Let b, c € S be such that ¢,(b)=¢,(c). Then (i, aba/a?, d) = (j, 
aca/a’, 1), implying i= j,A = p and aba/a* = aca/a*. Thus b, c € S,, and 
be =cb. This implies bac = cab by conditional commutativity. Multiplying 
by a, we have abac = acab and baca = caba, Using aba = aca we obtain 
abac = abab and baba = caba giving ac = ab and ba = ca by cancellation in 
the respective subsemigroups. These equalities imply c = 6 by weak can- 
cellation. Thus @, is one-to-one and is actually an embedding. 

Conversely, it is immediate that a subsemigroup of a Rees matrix semi- 
group over an abelian group is a matrix of commutative cancellative semi- 
groups. 

We call the Rees matrix semigroup Q (5); constructed in the above 
theorem, the quotient Rees matrix semigroup for S. We note that p,, in the 


theorem is the identity ifA=1 ori=1. 
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We next use Theorem | to give a new proof of a part of the following 
theorem from Petrich [7]. This theorem characterizes medial, weakly can- 
cellative semigroups. A medial semigroup is one which satisfies the 
identity, abcd = acbd, We will also have occasion to use square commuta- 
tivity which means that we always have (ab)’ = a?b? for a, be S. Finally 
a rectangular abelian group is the direct product of a rectangular band and 
an abelian group. 


Theorem 2. The following conditions on a semigroup S are equivalent: 
(i) S is medial and weakly cancellative. 


(ii) S is a matrix of cancellative semigroups and is square commuta- 
tive, 
(iii) S is embeddable into a rectangular abelian group. 


(iv) S is a subdirect product of a rectangular band and a commutative 
cancellative semigroup. 


Proof. We give only the proof of ‘‘(ii) implies (iii)’’ and refer the reader 
to Petrich [7] for the remainder. Let S be a matrix of cancellative semi- 
groups, which is also square commutative. Say S = Ai Ifa, be Says 


then a7b? = (ab). This implies ab = ba by cancellation in Sy: Hence S$ 


is a matrix of commutative cancellative semigroups. By Theorem 1 we know 
S can be embedded into the Rees matrix semigroup Q_(S) over an abelian 
group G. Let (i, a, A), (j, 6, uw) €S. By hypothesis (i, a, A)*(j, b, = 
(2, 4, 2, Hence (i, ap); 6p, b, ap); bp, ; b, 
so that Which implies This is exactly 
the requirement given in Petrich [6, IV. 3.3], that a Rees matrix semigroup 
is the direct product of a rectangular band and a group. 

If xa = xb for a, b, x € S implies a = b, then S is left cancellative, 
Analogously to a rectangular abelian group, a right abelian group is the 
direct product of a right zero semigroup and an abelian group. These con- 


cepts are used in the following corollary of Theorem 2, which is proved in 
Petrich [7]. 


Corollary. The following conditions on a semigroup S are equivalent: 
(i) S is left commutative and left cancellative. 
(ii) S is embeddable into a right abelian group. 
(iii) S is a subdirect product of a commutative cancellative semigroup 
and a right zero semigroup. 
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(iv) S is a right zero union of commutative cancellative semigroups. 


2. Quotient Rees matrix semigroups. We immediately give the theorem 
which justifies our earlier definition. As a corollary we will have the earlier 
known result for right zero unions of commutative cancellative semigroups. 
We then develop further properties of the embedding ¢ constructed in Theo- 
rem l. 


Theorem 3. Let S = 1U,Si. be a matrix of commutative cancellative 
semigroups, and _, be the embedding of S into Q_(S) given in the proof of 
Theorem 1. If @ is a homomorphism of S$ into T, a completely simple semi- 
group, then there exists yy a unique homomorphism of Q (S) into T which 
makes the following diagram commutative: 


(5) 
| 


| 
| 
T 


Proof. We will let S$ 1, be the subsemigroup of S used to construct ¢, 
and Q,(S)= M(I, G, A; P) as in the proof of Theorem 1. As we noted after 
Theorem 1, P has all entries in the row and the column containing P,, equal 
to the identity. 

By the Rees theorem for completely simple semigroups T = 
M(I', H, A‘; Q) for some group H. Since @ is a homomorphism it must take 
elements that commute to elements that commute. Hence @ induces mappings 
of I into I’and A into A‘. We will denote these mappings by primes so that 
if b €S,,, then 0(b)=[i', 6’, A’] € T, where we are using square brackets 
to distinguish more readily those of T from those of Q qo As an additional 
simplification, we will require that all entries of Q in the row and column 
containing 4,1, be identity elements, which can be done following [3, 3.4]. 

We next define a mapping w: S,, — H by 0(b) = [1', w(b), 1] (6 €S,,). 
Since S 11 BeNerates its quotient group G, we can extend w to all of G by 
w(cb~!) = w(c)(@(b))7!. It is easy to verify that @ is a homomorphism on G. 

Using , we define the mapping w: M(I, G, A; P) — M(I', H, A‘; Q) 
by W(i, b, A) = Li’, w(b), A] (© EG). We will show that is the required 
mapping. 

Let (i, b, A), (1, ¢, € Q,(S). Then 
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AMA, cy p)) = bes p) = [14 wlbe)s 
= wlb)olc), => {1 o(b)q | 


= [1', wfc), = U1, c, p).- 
Therefore it is clear that w is a homomorphism when restricted to U.S; 
Similarly it can be shown that wW restricted to US; is a homomorphism. 
We also note that it is immediate from the definition of w and W, that we have 
= vd, (>) for all in Sip so the diagram commutes on Sie 


For 0 in Si and c in Says we have cb in Sie Thus 


= O(cb) = Wd (cb) = (old = (0). 


Since O(c) and Wd(c) must be in the same subgroup of T, we must have 
O(c) = Wd(c). Hence the diagram commutes on U,S;, and similarly it will 
also commute on 


We now let c be in Sin and d be in Say So that d(c)=(1',c’, A’) and 
$(d)=(i',d', 1') for some c', d'in G. Therefore 


[1', 1] = [14 wlc’), AME’, 1’) 
= = = (cd) 
= [15 1] = 115 ola’), 


which implies that 4 ,,;1 = @(0, ;). 


We are finally ready to show that yy is a homomorphism. Let (i, 5, A), 
(j, Cy p) € Then 


W((i, b, p)) = bp, p) 


= [i’, albp, [i', alb)alp, alc), 


= [i, wb), oc), p'). 


Thus & is a homomorphism as required. 

We still need to show that the diagram commutes for any } in S. We 
already have this by definition for 6 in S,, and have shown this for all b 
inU > 1, and U > ‘1° Therefore we only have to check commutativity for 
an element c in S;,. We let be S11» So that bch is in S,,. Then O(b¢b) = 
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(bcb). Hence Ab) Ac) Ab) = Abcb) = (c) (b) = 

Ab) Wd _(c)O(b). Since O(c) and boc) are in the same subgroup, it follows 
that O(c) = Wd(c). Thus we have shown that the diagram commutes. It is 
also clear from the proof that any other map &’ which makes the diagram 


commutative must take the same action as W and thus is the same function 
and the theorem is proved. 


The following corollary for right zero unions of commutative cancella- 
tive semigroups is due to Dickinson [4]. 


Corollary. Let S = U, 5S, be a right zero union of commutative cancel 
lative semigroups, and ¢ be the embedding of S into Q (S) given in Theorem 
1. If 0 is an embedding of S into T, a right abelian group, then there exists 
Ya unique embedding of Q_(S) into T which makes the following diagram 


commutative: 


The next proposition shows that quotient Rees matrix semigroups are, 
up to isomorphism, not dependent upon the choice of the element @ used in 
the construction in Theorem 1. 


Theorem 4. Let S = VU, Sy be a matrix of commutative cancellative 
semigroups, and let a€S;, and be If we let be the embeddings 
of S inQ(S), O,(S) as constructed in the proof of Theorem 1, using a, b 
respectively, then there exists an isomorphism yy of Q (S) onto Q,(S) which 
makes the following diagram commutative: 


¢ 


9 (Ss) 


¥ 


| 
Q 


Proof. This follows immediately from Theorem 3. We have unique ho- 
momorphisms Van: Q,(S) and Vea 2,5) Q.(S) such that 
= >, and = but then = Thus ua 


s (s) 
| 
| 
| 
T 
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is the identity map on Q,(S) and similarly Wy, .W , is the identity map on 


,(S). Hence and are inverse isomorphisms. 


Corollary. For S = at RM a matrix of commutative cancellative semi- 


groups, the image of each S., under any ¢ in the proof of Theorem 1 gene- 
rates the group into which it is embedded. 


This is just one of the results needed in the proof of the proposition. 
The following corollary could also be derived from the already men- 
tioned work of Dickinson [4]. 


Corollary. For S = WSs a matrix of commutative cancellative semi- 


groups, all the S., have isomorphic quotient groups. 


3. Rees compositions. In this section we generalize the construction 
of Rees matrix semigroups to any semigroup and we characterize those semi- 
groups obtained by using commutative cancellative semigroups in this way. 
The special case of the direct product of a rectangular band and a commuta- 
tive cancellative semigroup is also studied. 

We need to introduce several standard concepts. A left translation X is 
a function, written on the left, of S to S which satisfies A(xy) = A(x) y for 
x,y €S. A right translation p is defined similarly when written on the 
right. A left translation A and a right translation p are linked if x(Ay) = 
(xp)y for x, y € S. The translation hull of a semigroup, denoted by 2S), is 
the set of pairs of linked left and right translations, (A, p), considered as 
bitranslations. If (A, p), (A’s p’) € QS) then multiplication defined by 
A, p)A', p')= AA’, pp’) € AS) makes Q(S) a semigroup. It is also clear 
that (t, ¢) € 2(S), where ¢ is the identity function on S written on the proper 
side, is the identity for Q(S). Hence one can consider the group of units of 
Q(S). A left translation A and a right translation p are permutable if (Ax)p = 
A(xp) for all x € S. A set of bitranslations T is permutable if for any (A; p), 
(A', p’) € T, we have that A and p’ are permutable. 

We extend the definition of Rees matrix semigroups to T = Ma, S, A; P), 
where I, A are any nonempty sets and S is any semigroup. However P maps 
A x I into a permutable subset of the group of units of N(S). It can be 
verified that this definition produces a semigroup when (i, 4, A), (j, 6, w) € T 
multiply as (i, 4, A)(j, 5, = (i, 4p); 6, where (ap, ;)b = a(p, = 
ap); b. We call Mil, S, A; P) a Rees matrix semigroup over the semigroup S, 

Since we are mainly concerned with matrices of commutative cancella- 


tive semigroups, we will consider here only Rees matrix semigroups over 
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commutative cancellative semigroups. It has been shown by Hall [5] and 
Dickinson [4] that 0(S) for a commutative cancellative semigroup consists 
of exactly those elements g of the quotient group, say G, of S such that 

gS CS, i.e. the idealizer of S in G. It is also immediate that, because of 
commutativity, all elements m € Q(S) are permutable. Hence in the case of 
a Rees matrix semigroup over a commutative cancellative semigroup we only 
require that p,, be a member of the group of units of the idealizer of S$ in its 
quotient group. We now present a theorem which characterizes Rees matrix 
semigroups over commutative cancellative semigroups. 


Theorem 5. Let S = Mt. be a matrix of commutative cancellative 
semigroups. The following statements are equivalent: 
(i) For all a, b € S, there exists c,d €S such that cba = bac, ba=ca, 
dab = abd, ab = ad, 
(ii) ForallaeS,ifae then aS as, and = Sy 


(iii) S is isomorphic to a Rees matrix semigroup over any S;)- 


Proof. (i) implies (ii), Let a € S,, and b€ Sus By the hypothesis of 
(i) we have an element d such that dab = abd and ab = ad. Thus de Siu and 
we have aS aS Therefore baS baS since ba € Since we are 
in a subsemigroup of a Rees matrix semigroup over a group, we have aS; C 
aS; and the first equality in (ii) holds. The second equality in (ii) follows 
Similarly. 

(ii) implies (iii), Fix a € Si. and construct the embedding of Theorem 
1. We claim that the image of S in MCI, G, A; P)= T, where G is the quotient 
group of S;,, is a subset of T of the form 1x S,, x A, 

To show this we observe from the proof of Theorem 1 that this is equi~ 
alent to showing that $(S,,,) = x x tpt or equivalently aS 
a’S .. Using the hypothesis in (ii), 


2 
a(S ; = aS =a‘S 


id 
proving that the image is as claimed. 

It only remains to show that the Pu; are in the group of units of the 
idealizer of S;, in G. We already know this if j= i or #=A since all such 
p uj are the identity as seen from the proof of Theorem 1. Let (j, 0, 4) and 
(k, c, A) be in the image of S in T. Then (j, b, 2) (k, c, A) = (j, d, A)(R, c, A) 
for some (j, d, A) in the image of S in T by (ii). Hence A = dp,,¢ = 
dc and thus bP, = d. This shows that P,, is in the idealizer of S;, in G. 
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By (ii) for each d €S,, there exists a b €S.. such that (j, b, u)(k, c, A)= 
(j, d, A)(k, ¢, A) which implies bP = d, showing that Pik takes onto 


S.,- Thus T is a Rees matrix semigroup over S... 
id id 


(iii) implies (i). Let S = INCI, T, A; P) be a Rees matrix semigroup over 
the commutative cancellative semigroup T. Then for a, b € S we have a = 
(i, a’, A) and b= (j, b’, It is immediately verified that c = (j, d) 


and d= (i, b #4) are the elements needed in (i). 

Note, Professor Petrich has suggested that the conditions on the sand- 
wich matrix, P, can be relaxed in the case of Rees matrix semigroups over 
commutative cancellative semigroups and he has characterized such semis 
groups. 

We also mention that a result entirely similar to that for direct products 
of rectangular bands and groups as mentioned in the proof of Theorem 2 can 
be proved for Rees matrix semigroups over any semigroup. We use this 
result in the next theorem to characterize direct products of rectangular 
bands and commutative cancellative semigroups. 


Theorem 6. A semigroup S is isomorphic to the direct product of a rec 
tangular band and a commutative cancellative semigroup if and only if S is 
weakly cancellative, medial and for any a, b € S there exist c,d €S for 
which bea? = ca*c and a*db = da’d, 


Proof. If S is isomorphic to T x B where T is a commutative cancella- 
tive semigroup and B is a rectangular band, then by Theorem 2, S is weakly 
cancellative and medial. We represent B as I x A with | a left and A a right 
zero semigroup, respectively. Let (a, (i, A)), (6, (j, w)) € Tx B. It is 
immediately checked that the elements (0, (j, A)) and (0, (i, u)) satisfy the 
requirements in the statement of this theorem for c and d, respectively. 

Conversely, assume S is weakly cancellative, medial and satisfies the 
requirements on elements in the theorem. By Theorem 2, S is a matrix of 
commutative cancellative semigroups, say S = Let a, b€S so 
that by hypothesis there exist c, d € S with bea? = ca*c and a*db = da’d. 

If c €S.. and de We have bca? = baca by 
mediality and aca = by right commutativity in Ui Sia from the corollary 
after Theorem 2. Thus ba*c = ca’c and since by Theorem 1 we are in a 
subsemigroup of a Rees matrix semigroup over an abelian group we have 

ba =ca. Hence by Theorem 5, S is a Rees matrix semigroup over any of the 
commutative cancellative semigroups S ;,. 
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We now let (i, a, A), (j, &, 2), (R, ¢, p) and (/, d, y) € S. By mediality 
(i, a, A) Gj, b, c, w) CI, 4, y) = (i, d, y). This 
implies that j Pup 
tivity and cancellation in the quotient group of the S;, for which we do 


using commuta- 
Lk Ak 


the embedding in Theorem 1. Hence, by the result referred to in Theorem 2, 
S is actually isomorphic to the direct product of the commutative cancella- 
tive semigroup S,, and the rectangular band I x A. 


Corollary. For a semigroup S the following are equivalent: 
(i) S is a Rees matrix semigroup of commutative, cancellative semi- 
groups with \I| = 1. 
(ii) S is a left commutative, left cancellative semigroup and for a,b €S 
there exists a c €S such that baca = ca*c. 
(iii) S is left commutative, left cancellative and SaC aS foralla eS. 
(iv) S is isomorphic to the direct product of a commutative, cancella- 


tive semigroup and a right zero semigroup. 
The equivalence of (i), (iii) and (iv) can be found in Petrich [7]. 


4. Examples. We discuss briefly free contents, prime quasi-uniserial 
semigroups and Rees matrix semigroups over Jl-semigroups. 

As defined by Tamura [10], the free content on two generators, denoted 
by C(a, b), is the subsemigroup of F(a, 6), the free semigroup on the two 
generators a and b, which consists of all words that contain both a and 6 at 
least once. 

It has been shown by Shafer [8] that any countable semigroup can be 
embedded in C(a, b). 


Shafer [8] denotes by A the congruence on F(a, b) generated by the 
identities a = a” and b = b*. He has shown that C(a, b)/X is a matrix of 


infinite cyclic semigroups. 

As a second example we mention prime quasi-uniserial semigroups as 
defined by Behrens [1], [2]. Let I be any set, G be the infinite cyclic group 
generated by w, C be the subsemigroup of G consisting of {w*|s = 0, 1,...}, 
and 7 be a function from | x I to the nonnegative integers, 
which satisfies the following conditions. If we denote (i, 7) by (7), 7 
must satisfy: 

1. (ii) = 0, 

2. (ij) + (jk) > (ék), 

3. (kj) + (ji) > 0, j. 
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The set S=1x Gx is a prime quasi-uniserial semigroup when we define 
multiplication by (h, i)(j, w', k) = (b, ***@), k). It is easy to see 
that S is a matrix of commutative cancellative semigroups. The conditions 


on 7 are also equivalent to the conditions that all e; = (i, w°, i), i € I, are 


idempotent and that T = U,, Cee. is a subsemigroup of S containing no 


further idempotents, where @°(h, i) = (h, w'**, i). It is easily checked 
that T is a matrix of commutative cancellative semigroups. Behrens uses 
such semigroups in the study of prime, arithmetic rings with identity. 

In fact both of the above examples can be considered as the more 
restrictive case of matrices of Jl-semigroups. An Jl-semigroup is an archi- 
medean commutative cancellative semigroup without idempotents. Tamura 
[9] has constructed all Ji-semigroups as pairs (G, I), where G is an abelian 
group and / maps G x G into N, the nonnegative integers, and satisfies the 
following conditions: 

(i) Ka, B)+ KaB, y) = Ka, By) + KB, y) (2, Bry €G), 
(ii) a, B)= KB, 2) (a, B € G), 

(iii) I(e, €) = 1 where € is the identity of G, 

(iv) for each a € G there exists m > 0 such that I(a™, a) > 0. 

The multiplication on S = N x G defined by (m, a)(n, B) = (m+ n+ (a, B), 
af) makes S an Ji-semigroup. 

Hall [5] has characterized the group of units of the idealizer of S in its 
quotient group, which we denote by 2(S). The characterization is that 


= {[0, gllg eG, I(g, b) >0, and I(g!, 0 
for all h eG, I(g, = 1}, 


where [0, g] is a function on S defined by [0, g](”, b) = (n + Kg, b)— 1, gh) 
using the Tamura representation (G, [) given above. 

If G is any abelian group then I: Gx G— {1} satisfies the above four 
conditions. For S = N x G, &(S) ={[0, glig « Gi. We can use these facts to 
construct many Rees matrix semigroups over the Ji-semigroup S. 

As another less trivial example, let G = fe, a, a’, a*} be the cyclic 
group of order 4. If we define I by I(e, a’) = 1 fori=1, 2, 3, 4, (a, a)=0, 
Ka, a?) = 1, Ka, a) = 2, Ma”, a*) = 3, K(a?, a”) = 3 and a>, a? ) = 2, then 
I satisfies the above conditions and =(S) = {[0, e], [0, a’ }}. 
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ABSTRACT. Given a flow CAR t real, over a probability space 2, we 
prove that certain measures on 2 (viewed as the state space of the flow) 
decompose uniquely into a Palm measure Q which charges no “polar set’’ 
and a measure supported by a polar set. Considering the continuous and 
discrete parts of the additive functional corresponding to Q, we find that 
Q further decomposes into a measure charging no ‘tsemipolar set’’ and a 
measure supported by one. As a consequence, Palm measures are exactly 
those which neglect sets which the flow neglects, and polar sets are ex- 
actly those neglected by every Palm measure. Finally, we characterize 
various properties, such as predictability and continuity, of an additive 
functional in terms of its Palm measure. These results further illuminate 
the role played by supermartingales in the theory of flows, as pointed by 
J- de Sam Lazaro and P. A. Meyer. 


0. Introduction. Let (Q, - ot P, 9,), t € R (the real line), be a filtered 
dynamical system (all terminology will be explained below). In $1 we prove 
that a finite measure Q on ps .. which is “‘progressively absolutely con- 
tinuous”’ decomposes uniquely into the sum of two measures Q= PZ +H, 
where P> is the restriction to fl of the Palm measure P, of a predict- 
able additive functional @, and p is supported by a “‘polar”’ set in - De- 


composing © into its continuous and discrete parts, say 2_ and @), we 


will see (in $2) that P> splits into a measure Fr. which charges no ‘“‘semi- 


polar’’ set and a measure P> which is carried by a semipolar, but charges no 


polar, set. Thus we have a decomposition 
(1) Q=P_+Pj+u 
analogous to that of a measure on the state space of a Markov process (1, 
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p- 283]; this is not entirely surprising in view of the Markovian nature of the 
flow 0,: (Q, F°) — (Q, 7 (see [9]). The decomposition (1) requires the 
Doob-Meyer decomposition of supermartingales and is related to Féllmer’s 
[3] correspondence between supermartingales and certain measures on R, x 
Q. As a corollary, we find that a finite measure Q on Views is a Palm 
measure iff it charges no polar set. The section concludes with a character- 
ization of polar sets, and several applications of these ideas, particularly 
to local times, 

In $2 we characterize various properties of a given additive functional 
a, such as well-measurability, predictability, and continuity, in terms of its 
Palm measure. Papangelou [14] has recently given some results on stationary 
point processes (which we constme as additive functionals which increase 
only by unit jumps) of the type we are considering. (Similar questions for 
Markov additive functionals have been treated by Revuz [16].) In the present 
article we will generalize several of Papangelou’s results and obtain flow 
theory analogues of some of the Markovian ones. Some of our material will 
be recognized as a specialization of results in the ‘general theory of pro- 
cesses’’ [2], with more detail made possible by additional structure, In fact, 
our intention throughout is to solidify further the bridge built between the 
general theory and flow theory by J. de Sam Lazaro and P. A. Meyer [8], [9]. 

The remainder of this section is devoted to an explanation of the termin- 
ology and background material. Our notation is largely that of [1, Chapter 0], 
with this exception: if (E, &) is a measurable space, we write (ambiguously) 
f € (&) to mean that / is an &-measurable function on E, the range being 
clear from context; f € (&), indicates the range is R, =[0, «). 

A flow 6 =(0,), t € R, on a probability space (Q, §°, P) is a one- 
parameter group (under composition) of bimeasurable, measure-preserving bi- 
jections 0 


t 


: 2 such that = identity and the mapping (t, w) ,(@) 
is ® @ F$°/F°-measurable. We further assume the existence of a filtration, 
i.e. an increasing family of o-fields {Ft t € R, on 2 whose generated o- 


field Visas is F*, and which is compatible with the flow @ in that 


= ,s,t€R. As usual we write = NF, 


s+t? 
Each - (and thus ¥°) is assumed separable. The P-completion of F° is 


denoted F, and then 7, is obtained by adjoining to i all sets in F of 


measure zero. The family iF, } is then right-continuous [2] and compatible 
with 0, but 0: (t, @) (a) need not be ® ¥/F-measurable. The entity 
(Q, rp P, 0,) is a filtered dynamical system, Concepts from the general 
theory of processes, such as predictability, are in reference to the family 
{F |} unless otherwise indicated. 
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An additive functional (AF) is a real-valued process & = a(t, w) (or 
a (w)), ¢ € R, @ € Q, such that (i) a(0) = 0; (ii) almost every path is right- 
continuous, nondecreasing; (iii) for each s, ¢ € R there is a set i e F 
of measure zero such that 


(2) alt +s, w) = alt, w) + als, 9 @) 


for w ¢ N ,,* By (ii) we may consider 4 as a measure on 8, Notice that a 
need not be adapted; sometimes we will use the phrase (due to Getoor and 
Sharpe) “‘raw additive functional’’ (RAF) to emphasize this point. We call 
a adapted if a(t) « (F,) for t>0, and this implies a(t) € F, if t<0. As 
shown in [9], there exists an AF @ indistinguishable from @ (i.e. such that 
@(t, w) = a(t, w) for all ¢ € R as.) which is perfect in that the set Noe 

in (iii) may be chosen independently of s, t, F°-measurable, and such that 
(iv) A(+te0, w) = to or A(t, w) =0 for every w € 2. 


Given an AF @, its Palm measure is 


(3) =E 1, 00,da, ( 00,da,), Ae 


where I, is the indicator of A. Palm measures arise naturally in the study 
of “‘flows under a function” [7], local times [4], ‘‘time-changes’’ of flows 
[17], point processes (‘*‘Palm-Khinhin formulae’ etc.), and level crossings 
(‘‘horizontal-window’’ probabilities), They are exactly the measures which 
neglect sets in 2 which the flow neglects (Theorem (10)). 

Finally, we will need these facts (see [5], [9]). P, is always o-finite 
and finite iff Ea(1) <0, in which case @ is called integrable and Ea(t) = 
tEa(1), Two AF’s ©, B are indistinguishable iff their Palm measures are 
identical, (In particular, P, = Pz.) In addition, if @ and B are both 
adapted (resp. predictable), then it is enough for the Palm measures to agree 
on 7, (resp. 


1, Decomposition theorems and characterizations of Palm measures. A 
function € € (F°) for which €00,(w) €(w) as t10 for all w € will 
be called translation continuous, It is shown in [9] that there exists another 
filtration {G°} such that c §, =F, for all € R, where iG} is 
the completed family corresponding to igo (see $0), and G° = Vero: is gen- 
erated by the translation continuous functions, Moreover, the mapping 
(t, @) 9, (@) is G°/G°-measurable. Since the two filtrations differ 
by sets of measure zero only, there is no. essential loss of generality in as- 
suming that F° is itself generated by the translation continuous functions, 
For reasons (in addition to those above) which will soon be apparent, we 
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(D) F¥° is generated by the translation continuous functions, 
(I) (Q, F°) is a Blackwell space. 

The meaning of (ID) is: (i) F° is separable, and (ii) for every realevalued 
E € (F°) and A € F°, the image €(A) is analytic in R. The basic fact we 
will require is this: let (E, &) be a Blackwell space and § a separable sub 
o-field of & A function { € (&) which is constant on the atoms of G is 
then G-measurable, (See [13] and [9, Appendix Chapter I].) 

We hasten to add that many of the results below do not depend on (I), 
though they are more complicated without it, and that most of the standard 
spaces arising in flow theory satisfy (I) and (ID. Two examples are the func- 
tion spaces © and 9 of all continuous functions (resp; right-continuous func- 
tions having left limits) from R to R; for f‘€ © (or 9) we let 6 f(s) = 
{(s +t), Xf= f(s), and = s<t}. Another example, arising in con- 
nection with point processes, is the space % of all locally finite (i.e. having 
no finite accumlation point) nonempty subsets of R. Here, for w € B, we let 
0,w=w-—t and take ? as the o-field generated by the functions N(A, w)= 
cardinality of AM w for Borel sets A C(-co, t], These examples will be 
discussed below. 

Let Z € G,). be such that Z, = e~'Zo 6,,¢ € R,, is a supermartin- 
gale relative to {F,}; Z is then called excessive, We need the following re- 
sult, which may be derived from [8] or [9]. 


(5) Theorem. Let Z be excessive, Then there exists an excessive Z° 
=Z a.s. for which Ze and the mapping t o (@) is right 
continuous and has left limits at every t € R, for almost every w € Q 


In particular, let Z = (Z,), t € R,, be a potential [13] such that Z,= 
ass. for each (Z is ‘talmost homogeneous’’). Then there exists 


a homogeneous potential z° =e7'Z° 6, with Z° as described in (5), such 


that Z) and Z, are indistinguishable. 


Let 8, denote the Borel o-field in R,, and define, for any process u € 
(B, ® F°), two new processes, 0°u and O~u, by 
w) = As, 9.0), uls, w) = us, 
These are measurable, and 0* and 0~ are obviously inverses of one another. 
Now define ?° to be the o-field on R, x 2 generated by all sets of the form 
[t, 0) x A, t € Ry, A € - (equivalently: all sets of the form {0}x A, A € 
and (t, 0) x A, € Ry, A € F?_). This is similar to the usual predict- 


able o-field [2], but more appropriate in the present context. 


_ 
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(6) Lemma. = @ ie. u € (P°) iff O-u € (B, @F}_). 


First note that (R, x 2, 8, @F°) is a Blackwell space, and B, @ x. 
is a separable sub o-field of B, ® F°, Consider a generator of P°, say 
[t, 0) x A, with A € , and let us, w) = 4(@)- We wish to show 
is constant on the atoms of ® Suppose (s, a), @‘) are 
contained in such an atom. Then, for every B € B,, C € i o~» we have 
1,(s)I so s=s' and w," lie in the same atom of 
both vanish if s < t, and are equal if s > t, because then 0A € Fins s-¢ 
_. We have shown _). Next, let v € B, _) be of 
the form s, w) =I fa), Be Ceé that P° isa separas 
ble sub o-field of 8, ® $°, we will show that 0*v is rena on atoms of 
9°. Let (s, a), (s‘, be in an atom of 9°. Then s=s’ , and | = 
I every A € _+ Thus Xs, =1 POR CE @) @) 
since 07 The proof is complete. 


(7) Corollary. (a) If t € R, and A € then (t, 0) x A € 
(b) If € € then the process €° 0 =(€ (@)) is P°-measurable, 


Part (a) results from (t, x _j(t+27 x A; (b) is trivial. 
To each measure O on » A we now associate a measure 0 on f° a 


follows, Writing Olu) for fu do, 
(8) Olu) = [en ws, ue (P),. 


We further write 6,(A) = Ol(t, o)x A], A € » ” which is possible by (7)(a), 
and call Q (or Q) progressively absolutely continuous (relative to P) if, for 
each € Ry, on equivalently, 0, <P on 


= 

(9) Theorem. A finite measure Q on 7h which is progressively abso- 
lutely continuous may be written uniquely as Q=P>+p where PZ is the 
restriction to Fle of the Palm measure of an (integrable) predictable AF a, 


and the measure p is concentrated on a polar set, 


The meaning of ‘‘polar” is this. Let € be a random variable on Q; the 
random set Sz (o) ={t: €0 6 (w) #0} is called the spoor of & If €= I 4, we 
speak of the ‘‘spoor of A’’. Then E(or A if €= 14) is called polar (thin) if 
its spoor is a.s, empty (a.s. locally finite). Thus € is polar iff §° 0 = 
(Eo 0 (w)) is an ‘‘evanescent’’ process [2]. Further, A is semipolar if it is 
contained in a countable union of thin sets, As indicated earlier, PZ further 


decomposes into a measure which charges no semipolar and a measure which 
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lives on a semipolar, but charges no polar, set (see $2). We note that if Q 
charges no polar set in Feat then (using a Fubini argument) it is progres- 
sively absolutely continuous, 

As an immediate consequence of (9) (using the trivial filtration a = F° 
for (b)) we have 


(10) Theorem. (a) A finite measure Q on 7. is the restriction to 7... 
of the Palm measure of an integrable, predictable AF iff Q charges no polar 
set in 

(b) A finite measure Q on $° is a Palm measure iff 0 charges no polar 
set in ¥°, in which case the corresponding AF (a) is the right-continuous 


regularization of (dQ'/dP) where Q‘(A) = So ds, A€ 


Proof of (9). The uniqueness is clear, since (3) implies that a Palm 
measure charges no polar set. Let Z, € Oi). be the Radon-Nikodym deriv- 
ative dQ /dP on » 9 Since t — EZ, is right-continuous one may choose 
an a.s. tight-continuous version Z =(Z,) and it is easy to see that Z is a 
potential, though not necessarily of class (D) (see U3) for terminology). 

Now a change of variables yields Q,(A) = e708, A), A € Fas » from 
which follows immediately that, for each ¢ € R,, Z, = e7 ‘Ze °0, as. By 
the remark following (5), we may assume Z, is homogeneous: Z, = 
° 

It is well known that any potential Z has a unique decomposition Z = 
N + Y, where N is a local martingale (and also a potential) and Y is a 
potential of class (D). We show now that N and Y may be chosen homo- 
geneous. Notice that Z,, (w) = e~ 2, ° 8 (w) for all w, s, t. For ¢ fixed, 


t+s 
consider the following two decompositions of Z s>0. 


t+s? 
Y igs? 


(11) 
e~'N, 08 08). 


It is tedious, but straightforward, to check that both N,,, and e~'N,° 6, 


s > 0, are local martingales and that both Y,,, and 6,,5>0, are 


class (D) potentials, all relative to the o-fields pom s>0. By 


uniqueness, the two expressions ‘‘match’’ correctly, and we conclude Nias™ 
-t 
en, ° 0, for all s, a.s., and similarly for Y,,5¢ Putting s =0, we find 


N, Y are ‘‘almost homogeneous’’ and may be replaced by homogeneous modi- 
fications, which we again denote by N and Y. 

By the Doob-Meyer decomposition theorem [ 13, p. 119] we may write Y= 
M-A, where M=(M,) is a uniformly integrable martingale, and A = (A,) 
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is a predictable (= natural) integrable increasing process. Since Y is homo- 
geneous, we have two decompositions of Y,,, for s >0 (¢ fixed) analogous 
to (11): 


tts A, <2 A), 


Noting that e~‘M. © 0, and M,,,-—A, are uniformly integrable martingales, 
and A... 
tive to iF 4s }, s>0, t fixed), we have by the uniqueness of the decomposi- 
tion, 


t+ 


- A, are predictable increasing processes (all rela- 


Now let = dA ,. (By we will always mean From (12) it 


follows easily that @ is a predictable AF. (This argument was inspired by 
Maisonneuve [10].) 


Now for any Palm measure, say Pg, we have (see (s}) 


(IDE us, 0) = ff us, we(B@F,. 


0 
Hence for any A € ie 


E(Y,; A) = e~*da.; A) e~*P,(0 ds. 


So we may write 
(14) 0,(4) ds = E(N,; A) 00 (A)ds, 


Now define a measure pf’ on P° by equation (8) with QO replaced by p = 
Q-P., Pz. being the restriction of P, to os Using (14), we see that 
jf is positive on sets of the form (t, «) x A, A € Fe and hence on all of 
9°; moreover 


(15) E(N,; A) = 2) x A] =f 08,(A) ds, Ae 


(The existence of a measure jt on R, x satisfying the first equality in 
(15) is established by Féllmer [3] in a different situation.) It is easy to see 
that 4 >0 so it only reamins to prove that p lives on a polar set. 

Having chosen N homogeneous, i.e. N, = e~ ‘7 © 0, for an excessive 
function n € a ie note first that we may extend N, to all ¢ € R and 
still have a supermartingale. Moreover, N, will be right-continuous with 


finite left limits for all ¢ € R a.s. since t —7” © 6, has these properties. 
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Define, for each n> 1, R= inf {r > 0, rational: n}, Each R, € 5°, 
family of stopping times of iF? ah t € R,, and on EER, ie co- 
incides with inf{r > 0: with discrete T € 8°, one easily 
shows that the interval ]]T, oll € P° for 5° , and hence 
K= The argument in [3] shows that is by K 
and that K is evanescent. (The set K in [3] is slightly different, but, since 
p puts no mass on {oo} x 2 because N, is a potential, the argument given 
there goes through.) 

Define &(w) = Tl, 0_,w) dr; since K € (6) implies € 
Clearly p(&) = and p(1- €) =0, Hence €= 12 p-ae, and 
plé =0}=0, ice. p lives on the set {€>0}. To show this set is polar, let 
G be the set of w € 2 on which the trajectory N(@) has finite left limits 
and is right-continuous at all t € R. Then G, and so G, is invariant, and 
P(G°) =0. Suppose &(w) >0. Then (r, 0_w) € K for some r>0, i.e. 

R (@_,@) <r for all 2 > 1, and this puts @ in G°, But {£>0}CG° implies 
{€>0} is polar since G° is an invariant null set. This completes the proof 
of (9). 

We now sketch the proof of another decomposition for an arbitrary (finite) 
Q on i which is valid under the additional assumption that {Fo} isa 
standard system (3), [15], which means 

(a) each » is 0-isomorphic to the Borel o-field of a Polish space; 

(b) for any increasing sequence ¢,, and decreasing sequence of sets A_, 
such that A, is an atom of i » we have NA, 42D. 

Unfortunately, the usual filtrations on the standard spaces of flow theory, 
such as © and 3B previously mentioned, are not standard in the above sense. 
We will indicate later how to circumvent this difficulty for those two cases, 

Let Q be a finite measure on » and define 0 as before (see (8)). 

For each te R,, the measure 0, a Lebesgue on 
namely 0, (A) = + OF (A), with <P on Fee and 1 P on 
(1 means “‘singular’’), An easy argument using the uniqueness of the ntl 
besgue decomposition shows that 0, and =e” 05 ° Let 
Z,= dQ on We may choose a homogeneous version of the potential 
Z =(Z,) just as in the proof of (9), and this splits into a local martingale N 
plus a class(D) potential Y, both of which are homogeneous. Now let ji be 
the Féllmer measure of the local martingale N, i.e. the unique measure on _ 
such that the first equality in (15) holds, We thus have, @ being as in the 
proof of (9), 


(16) 


~ 

+? 
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where 0, is defined by the right-hand side of (8) with P, in place of 0, = 
In this way, x Al = Q7(A), A € 

Equation (16) exhibits Q as the sum of the progressively absolutely con- 
tinuous measure +i and the ‘‘progressively singular’ measure 
One establishes easily that such a decomposition is unique. 


Define measures p, v on by p(A) = © = © @). 
(17) Lemma. For every u € * a 

(18) Ru) = «w) ds 

and similarly for Y and v. 


Proof. Define a transformation T, on B, @F° for each t € Ry by 
T ws, @) = u(s + t, 9_,@). A monotone class argument shows that T,: (P°), 
—+(P°),. From (8) we find that 


(19) O(T x) = teR,, we (P°),. 


By looking at the generators of P°, we also find that MC T,u) defines a pro- 
gressively absolutely continuous measure, while D(T x) is progressively 
singular (t fixed). The uniqueness of the decomposition (16) shows that (19) 
holds for M (resp. D’) in place of Q; since Q,. also satisfies (19), so does jr. 

In view of (6), it will suffice to verify (18) for u = O°(It, soy)» t>0,é«€ 
Gre in which case the right-hand side of (18) reduces to e~ fi(€° 0). The 
left-hand side is 


= ° 9). 
The fact that p is carried by a polar set is proven just as before and we 


can state, given that {F? 3 is standard: 


(20) Theorem. A finite measure O on i may be writtenas Q=P7F + 


ft+v, where PZ and p are as described in (9), and v is such that 


=f, e~S0-us, a) dsXdw), ue(P),, 


is progressively singular. 


As we indicated, the spaces ©, 9 and B are not standard. To illustrate 
how to overcome this difficulty, introduce the space ©’ consisting of all 
functions {: R ~ R U{A}, where A ¢ R is an adjoined ‘‘death point”’ such 
that is continuous on R for all t < and f(t) =A for all >. The “‘life- 
time” depends on f. Clearly © CC’, and f € © iff €=+00. Again let 
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6, ‘‘shift’” by t, X,f=/(d, and define =0{X., <t}, all relative to 
In this way, =F ©, © is an invariant of ©’, and a stationary 
measure P on naturally to ©’ by P "(A) = P(A NG), AeF'= 
V,5 . The filtration {F’ , } is‘standard. (To “‘standardize’’ %, one intro- 
duces 3%’ consisting of all nonempty subsets w € R which are locally finite 
before ¢ = sup w < oe, We only pursue the case €'; the argument for B is 
entirely similar.) 

Let Q be a finite measure on =€ AF and extend it to by 


Q'(A) = A € By (20) 
(21) Q'= Pl+pt+y, 


all measures on Fo Restricting each of these to 7. C » _ we obtain a 
decomposition of Q; it only remains to show it is of the desired form. Now 
P> kills every polar set in - since every polar set in F° relative to P 
is also polar relative to P'; indeed, the restriction to © of P, is the Palm 
measure of the restriction of a to ©. As for the restriction to > il of p, it 
is obvious that it lives on NC, where N € Fos is polar and p(N°) = 0, and 
that NCE € Wis is polar. One also can show that v restricted to Fee is as 
in (20). 

Jiesty we remark that, if we write the Lebesgue 
and (with the obvious notation), 


= E(Z,; A) + K(A), Ae 
OMAN = EZ; KA), 


where K,, K; are P-singular (resp. P "-singular), and Zi Zz. are the Radon- 


Nikodym derivatives of the P-(P'-) absloutely continuous pieces, then Z, 
Z' are potentials and the pieces match properly. Indeed, Ki(A ‘)= K (A ’€), 
and Zz; may be taken as the “‘canonical extension”’ of Z, to €': first choose 
the homogeneous version es Z, and then let Zz. (f) =0 if t>¢ and Zz; ({) = 
Z if t < ¢, where € © is any function with for all 

s < t+e for sufficiently small > 0. The -measurability of Z, guarantees 
the definition to be independent of the choice of /, and Z’ is ae homo- 
geneous. 

It is an open question whether every filtered dynamical system can be 
embedded in a standard system as in the above examples. We should also 
mention that the measure v in (20) is something of a mystery to us. 

We conclude this section by pointing out two applications of our results. 
Let A’=(A,), t € R,, be an integrable, increasing process relative to iF i, 
that is (see [2]), A, =0,A is right-continuous, nondecreasing and EA, < ~, 
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Define a measure p, on R, x by 


pala) = Ef; us, dA fo), ue(8,® 


and a(finite) measure 0 on F° by Q(€) = wale © 4). Obviously, QO kills 
every polar set in ¥°, and hence by (10) is the Palm measure of an (inte- 
grable) AF a. One easily checks that, in fact, 


a. (w) = teR,. 


We call a the additive projection of A. A special case of this is used in 
[6], and Mecke [12] has noted a similar idea. 
The following result has a Markovian analogue [16]. 


(22) Theorem. A set N € F° is polar if and only if it is charged by no 
Palm measure, 


Proof. If N is polar, we have already observed that P(N) =0 for every 
AF a, Suppose N is not polar. Its spoor $,(w) is then nonempty on a set 
of w having positive probability; in fact, for almost every w € 2 for which 
Sy) #@, we shall see that Sy) is unbounded above. Observe, to begin 
with, that S,(w) is a “*homogeneous set’”’ in the sense that for every ¢ € R, 
Sy(0,@) = Sy(@) - t. Let By = {sup Sy > n}. Since the projection on Q of 
sets in 8 @F isin F (see (2, I., T32]), BL € F¥ for each n > 1. The ergodic 


theorem now yields 


lim Ig (9_,0)ds = P(B,|® as. 


where @ denotes the 0-invariant o-field in 2. Suppose S,y(@) # B. Then 
SyO_ .o) = Sy) +s has supremum greater than n when s is sufficiently 
large. Hence if B = {S, #9}, we have P(B \@) = 1 a.s. on B. Since B is 
invariant, P(BN B*) = 0, which proves our point. 

Now set D(w) = Sy(w) N(O, ~) € B,; clearly P(D 4B) = P(B) > 0. Ac- 
cording to [2, I., T37], there exists a nonnegative random variable r € (F), 
such that r(w) € D(w) for Dw) # and otherwise 7 =~, Define an integrable, in- 
creasing process A = (A,) by A ,(@) - Nhe 1H): A is flat, except for 


a unit jump at 7 if r<oo, We then have 
Bally 06) = ly 08,(0) dA (a) = Elly 08,3 D 4B) = P(B) > 0. 


By our work above, P(N) =p4(Iy ° 0) >0, where @ is the additive projec- 
tion of A, and (22) is proven. 

Note. A similar argument, using the material in [2, Chapter VI (esp. $3 
and T37)], shows that a set N € F° has ana.s. countable spoor Sy) iff 
P(N) =0 for every continuous AF a, 


| 
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For our second application, let X =(X,), ¢ € R, be a strictly stationary 
measurable process such that X, = X, ° @,, and assume X is adapted to a 
filtration iF? }. Denote by (E, &) the state space of X, with & assumed 
separable, and let 7(I) = P{X, € T'} (independent of #) be the one-dimen- 
sional distribution of the process. We say that X has a local time if there 
exist AF’s a* = (2°), x € E, such that, for almost every w € 0, 


(23) f'1(x(o)ds forall reR,, Pe. 


(Suitable measurability restrictions must be imposed; we omit the details.) 
Let {P*}, x € E, be a regular conditional probability given Xp, i.e. a family 
of measures on F° such that, for every A € F° Te & P(A, X, € T) = 
fP*(A)a(dx). We know [4] a local time exists iff P* is a Palm measure for 
mea.e. x € E (in which case the AF’s are predictable for a.e. x). 

Suppose only that there exist AF’s &* which are predictable and such 
that P* =P , on fora.e. x. Set 


for: € R,,T &. An easy computation shows that and al have the same 
Palm measure on Tas hence on all of F° since pt and a! are both predic- 
table. Consequently al() = B¥w) for all t, a.s., which yields (using sepa- 
rability of &) al (w) = Bw) for all ¢ and all I’, a.s. Thus we have proven 


(24) Theorem. A local time exists iff, for almost every x € E, the mea- 
sure P* charges no polar set in - ie 


Notice, however, that ‘‘polar’’ is defined in terms of sets in 1 which 
are avoided by the flow @, rather than those in E which are avoided by the 
process X,. 

We conclude with an example, based on a construction due to Maisonneuve 
[10], of the “local time’’ of an arbitrary random set. Suppose, for each w € 2, 
we are given a Borel set M(w) of R, homogeneous in that M(0 ,@) = Mw) -t 
for all t € R, w € Q. (For example, M(w) = {t: X,(@) = 0} with (X,,) as above.) 
Define 7 = inf(MM (0, ~)) (or r= 00 if MM(0, is empty), and (@) =t+ 
1° @ (w). The random variable 7 is “terminal”: r= 17, whenever > t. 

Let Z = E(e~"| J 9). Then Z is excessive, and by (5) we may choose a 
nice version of Z so that Z, = e~ ‘Zo 9, is a homogeneous potential, obvi- 
ously of class (D). Proceeding as in the proof of (9) we write the decomposi- 
tion Z,=M,-A,, and let a, = fje*dA,. Then @ is a predictable AF. Un- 
der further conditions on M, (dt, @) is a.s. carried by M(w). The Palm mea- 
sure of & is 


z 


POLAR SETS AND PALM MEASURES IN THE THEORY OF FLOWS 153 


where is the “‘predictable projection’? of Put another way, is just 
the predictable projection of -e'de't (see $2). If X = (X,) has a local time, 
say a”, we do not know the connection, if any, between &* and the local 
time of M*(w) = {t: X,(w) = x}, x € E, at least outside the Markov case. 


2. Characterization of additive functionals. With assumptions (ID), (ID 
of §1 still in force, we will need the following basic fact, borrowed from [8] 
(see also [9]). 


(25) Theorem. For every € € (F°) which is either bounded or nonnegative, there 
exists €" (resp. é*e such that (E" © t € R(resp. (E* 
is the well-measurable (resp. predictable) projection of the process (€° 9), t € R. 


Moreover, é* (resp. é*) is bounded or nonnegative with € and is unique 
up to a polar function. We note that the process €*° @ is actually in (?°) 
by (7)(b) while the notions of well-measurability, etc. refer to the family {F 3. 

Our results in this section will be of two kinds: the first type classifies 
an AF @ in accordance with the behavior of P, under projection, while, in 
the second type, we give conditions under which, for example, the dual pre- 
dictable projection of @ is a.s. absolutely continuous. These latter results 
are generalizations of some of the work of Papangelou [14]. 

Before going on, we recall some material from the general theory of pro- 
cesses[2]. Let u = (u(t, w)) be a process and A = (A ,(@)) an increasing 
process, EA, <~, t € R,, and iF 3 an increasing family of o-fields on 2 
which is right-continuous and with each ¥ , completed by all P-null sets. We 
write , P for the well-measurable (resp. predictable) o-fields on R, x Q, 
and note that 2? c@. The accessible o-field falls between ? and @, but will 
be omitted from our discussion. 

Writing w(u) and p(u) for the well-measurable and predictable projections 
of the process u, the dual well-measurable (resp. predictable) projection of 
the increasing process A is defined as follows: A” (resp. A”) is the unique 
well-measurable (resp. predictable) increasing process such that 


(26) Ef wlu\(s, dA(o)= Ef dAv(o), ue(B,@5),, 


and similarly for A®. For an increasing process, we note that well-measura- 
bility is equivalent to being adapted, 
For an integrable RAF @, we now denote by af (resp. a*) the dual well- 


measurable (resp. predictable) projection as defined above. 
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(27) Theorem. The increasing processes a" a™* are AF’s whose Palm 


measures are 
(28) E E(é),  &e(F,. 


Proof. It suffices to treat the predictable case, the other being entirely 
analogous, even somewhat easier. Suppose, for the moment, that a” is an 
AF. Let &€ a Then p(& © 0) = &* 0 @, and the predictable version of 
(26) gives 

Ef, e~S£o 0 _a*(ds) = a(ds), 
i.e. (28) holds. To show @* is an AF, it is enough to establish 
*. * oA. 
(29) Fla*, at; A] = Al, 


The left side of (29) can be written as 


where P(A|F _) denotes the left-continuous modification of the martingale 
P(A|F ). Using stationarity of the flow, it is easy to prove that, for each 

r, t, P(A|F, = PO, A|F,_)° 0, a.s., and so, formally, the last displayed 
expression becomes 


The problem is to show that P(O,A\F _) ° 0, may be chosen indistinguish- 
able from PIAIF os as r varies. However, both processes are a.s. left- 
continuous in r, hence are indistinguishable. Q.E.D. 


Since Palm measures determine AF’s (up to indistinguishability): 


(30) Corollary. An AF a is adapted (resp. predictable) iff E (€) = 
E (é") (resp. E(€) = E,(E*)) for every € (F°),. 


Notes, (1) If @ is adapted, then a will be predictable iff E (&) = 
E (é*) for all € € (Fo ,), Since the Palm measure of an adapted AF is com- 
pletely determined by its action on rr 

(2) Since PZ kills polar sets in ee there exists (by (10)(a)) a predict- 
able AF B such that PG = PZ; in fact, B =a" since E,(€) = E,(&*) = 
E (é") = E_.(€) for € € (F°),. 
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(31) Corollary. Additive projection (see $1) preserves well-measurabil- 
ity (resp. predictability). 


We consider next the splitting of an AF @ into the sum of a continuous 
AF a_ anda purely discrete AF @ ,, i.e. the measure & (dt, w) has no atoms 


for each w € ©, whereas a (dt, w) is the sum of countably many point 
masses depending on w € 2. The corresponding Palm measures are denoted 


P Given and are obtained from the usual decomposition of 
a measure into a continuous plus a discrete piece. If @ is adapted, @_ and 
a4 will be likewise, and a will be predictable; if @ is predictable, ay will 
be also. Let A € F° have an a.s. countable spoor S,. Clearly P(A) =0. 
In particular, this is the case when A is semipolar. 

Now consider the discrete part 2. Denote the mass on {0} by A: A(w) 
= 2 (0, w) - a {0-, w) =-2 ,(0-, w) (there is no restriction (see §0) in as- 
suming A € (F°),); also let A (@) = A ° 6, (@) be the mass on {t}, It is 
well known that P , is supported on the set 2, = {A> 0}. Writing 2, = 
U%_,!4 > 1/n} and recalling that a, is finite on compacts, we see that 0, 
is semipolar. 

When © is predictable, we get a finer decomposition: we can then show 
that P , is supported by a semipolar set in a and this in turn will lead 
to the decomposition promised in $1. 


(32) Lemma. The Palm measure of a purely discrete, predictable AF a 
is carried by a semipolar set in ae 


Proof. We choose for @ the ‘‘perfect version’’ described in $0. The 
process Ao, = a(t) - a(t-) is then predictable, and is therefore indistin- 


guishable from its predictable projection A* o 9. It follows that the set N* 


= {A*> 0} (which is in ie is semipolar since its spoor is a.s. the same as 
the spoor of © ,, and P (A* = 0) = 0, since Palm measures fail to distinguish 
indistinguishable processes. The set N* is thus the one required by the 
theorem. 


The following is now immediate upon recalling our remarks in $1: 


(33) Theorem. A finite measure QO as in (9) has a decomposition Q = 


where P~ charges no semipolar set in lives ona 


semipolar, but charges no polar set in a and lives on a polar set in » Ae 


As a consequence of (33), we obtain the following refinements of the re- 
sults in $1: 


(34) Corollary. (a) A finite measure Q on F° is the Palm measure of 


156 D. GEMAN AND J. HOROWITZ 


a continuous AF iff Q charges no semipolar set. 


(b) For an AF a, a” is continuous iff P, charges no semipolar set 
in F° 


Part (a) follows by taking the trivial filtration F = F° in (33), and part 
(b) from (33) and the note following (30). 
A similar situation obtains for discrete AF’s: 


(35) Corollary. An AF a is purely discrete iff its Palm measure is car- 
ried by a semipolar set. 


If N is semipolar, it is contained in the union of thin sets B_, so we 
may consider N thin. By the argument in the proof of (22), the spoor $,(w) 
will be unbounded in both directions a.s. Since N is thin, we may enumerate 
the points of S,y(w): ... R_ < <0 <R,@)<..., and we have 
R=, +R, ° OR. for each integer n. Define (dt, w) as the measure 
which puts unit mass on each R_(w). We leave it to the reader to check that 
v is an AF and that a(dt, w) <v(dt, w) for almost every w € 2 (to show 
this it suffices to check 0 <P), The general semipolar case is an easy 
extension of this method. 

We conclude with a characterization of the absolute continuity of a* 


in terms of P, similar to that given in [14] for point processes. 


(36) Theorem. The following three statements are equivalent: 
(a) a* isas. absolutely continuous (i.e. a*(dt, @) K dt); 
(b) P, <P on 

(c) 'E(a(t)|F,) converges in L} norm as tlo. 


Proof. Suppose a*“dt, w) = &(t, w) dt. Then, for any A € a P (A) = 
Ps (A) = dt; A) which proves (a) = (b). Conversely, assum- 
ing (b), we can write dP> = dP for some € € ee Now for any 7 € 
E E = E(&*) since € If 7 =0 a.s., the same 
is true of n', hence P <P and we can conclude that a*(dt, @)= 
€o 6 (@) dt, since both are predictable and have the same Palm measure on 
Thus (b) = (a). 

We next show that (a) is equivalent to (c). Recall the local ergodic the- 
orem [9] which states that, if € LQ, F°, P), €00.ds > € (as 
t 10) a.s. and in L!, Now from the definition of a* we have E(a(t)|F,) e 
E(a*(t)|F,) (see [2, VT 37]), and, assuming (a), we have 


(37) B(a()| F,) = £0, 
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for some & € L}, But ngs Eo 0 ds &(L}), so the right member of (37) 
converges in L! to € as well. 
Conversely, assume that converges in L! to some 

which we may take in Again using Ela(t) a(s)|F = Fla*(t) - a*(s)|F 1, 
s <t, we will show 

1 1 
(38) E Y,a*(ds) = E Y £00 ds 
for every continuous, adapted, bounded process Y .. Equation (38) then extends to 
all predictable processes Y; since a*(t) and f are each predictable, (38) 
implies a*(t) = for all t, as. 


Before proving (38), we require 


(39) Lemma. For 0 < €€ L! and Y as described in (38), 


n—oo 


n-1 
(40) lim > /n€°%n/n= Jo £00 ds (in L}). 
k=0 


The L'-norm of the difference of the two members of (40) may be written 


n-1 
(k+1)/n 
n ° /n 2 Y £09. is < + 


n-1 
(k+1)/n 


Let <M<oce for all s,w. Then 


n-1l 
M i/ne 
C.3F nf, $09, ds 0 
0 


by the local ergodic theorem. Also, 


n-1 
1/n 


n-1 
< 2M = 2M 08, ds 
0 


since €> 0; hence D’ is dominated by an L! function. Now, for w € 2 


fixed, Y(w) is uniformly continuous on [0, 1]; hence, given 0, IY, ,(@) 


| 
where 
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for all sufficiently large n, all k <n 1, and alls in [0, 1/nl. 
Thus D* < © ds for n large; by dominated convergence, 
and ( 39) j is proven. 

Returning to the proof of (38), we have only to show 
n-1 


0 


n—oo 


Let 
-1 


-|z - Y,/,)a*(ds). 


Since |Y| < M, we find At < 2Ma*(1) € L}; on the other hand, given « > 0, 
A’ < €a*(1) for all sufficiently large n, by a uniform continuity argument 
such as the one above. Hence by dominated convergence EA’ — 0 and we 
conclude 


(42) a*(ds) = lim Y (a*(k+1)/n a*(k/n)) (in L), 


Now a"(k Also 


l/n 


n-1 
-1 


0 


-1 n-1 


0 


n-1 


0 


M | F by assumption. 
Putting (40), (41) and (42) together, we finally obtain (38). 
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ABSTRACT. Formal deformations (expansions and collapses) of dimen- 
sion <3 among 2-dimensional polyhedra are explained in terms of a cere 
tain collection of operations on finite group presentations. The results are 
valid for any simple homotopy type of 2-dimensional polyhedra, and simpli- 
fications are possible within the simply connected simple homotopy types. 


1. Introduction. The relationship between finite group presentations 
and finite 2-dimensional polyhedra is in evidence at various places in the 
literature. Furthermore, the folklore has it that there exists a correspondence 
from the category of finite group presentations and certain operations there- 
on, to the category of 2-polyhedra and 3-dimensional formal deformations 
(expansions and collapses). The purpose of this paper is to give a precise 
formulation of the problem, with solutions, thereby exonerating the folk. The 
references listed here, with the exception of [2], are articles in which this 
problem has been addressed to some extent. 

Whitehead showed [5] that any two n-polyhedra having the same simple 
homotopy type are formally equivalent under deformations of dimension n + 
1, provided n> 2. For n= 2, one must apparently deform through 4-dimen- 
sional polyhedra. The reducibility of the dimension of the deformation to 
three is equivalent to the group theoretic problem to be described here. 

The author is greatly indebted to the referee for suggesting a proof of 
Lemma 2 and for contributing substantially to $8. 


2. The complexes. We shall initially restrict our attention to a special 
class C of 3-dimensional CW-complexes, defined as follows: If X € C, 
then: 

(1) X) consists of a single O-cell v. 


(2) X©) is the union of X° and a finite collection ix} of l-cells 


whose boundaries are attached to v. 
(3) X°2) is obtained from X‘! by attaching to X°) a finite collection 
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le} of 2-cells, where Bd e, is subdivided into edges and vertices; each 
vertex of Bde; is sent to v and each (open) edge of Bd e; is sent either 
to v or homeomorphically to some (open) x,. 

(4) X°) is obtained by attaching to X‘?) a finite collection id;} of 


3-cells, where Bd d; has the structure of a cell complex; each vertex of 


Bd d; is sent to v, each edge to v or homeomorphically to some x, and 


each (open) 2-cell homeomorphically to some (open) e,, subject to the usual 
condition that the attaching map be continuous. 


3. Elementary expansions and collapses in C. An elementary 
n-expansion K/L in C is defined provided L = K U,B”, where /{ 
attaches (as in2(4))to K all of the boundary of B” except one (open) 
(n - 1)-cell. An elementary n-collapse in C is the inverse of an ele- 
mentary n-expansion, written L\ K. 

There are no l-expansions or l-collapses in C because each K € C 
has only one vertex. 

A formal n-deformation from K to L in C is a finite sequence iKo, 
-++,K_} in C such that K) =K, K, =L, K, expands or collapses elemen- 
tarily to K;,,, and dim K; <n for all i. 


4, Presentations. We depart somewhat from the usual definition of a 
presentation in order to obtain a correspondence between presentations and 
complexes in C, A finite group presentation will herein consist of a set 
ix,} of distinct symbols, called the generators, together with a set {r,} of 
distinct symbols, called the relators; {x;} and {r;} shall be indexed by fin- 
ite subsets of the natural numbers. Associated with each relator r; is a 
word p; (not necessarily reduced) in the generators ix}, and the group pre- 
sented is the quotient group F{x,} modulo the normal closure of the {p,}. 
We shall use the standard notation {{x,{|{r,}} for a presentation. 

Two presentations {{x,j|{7;}} and {ly,j|{s,}} will be considered equal if 
and only if there exist 1-1 correspondences {x;}++ly,§ and {r,}¢>{s;} which 
preserve the words associated with the relators. 

Associated with each presentation p = {{x,||{r;}} is a 2-complex K(p) 
€ C, unique up to homeomorphism, which is obtained by attaching 1-cells 
ix,} to v, then attaching 2-cells {e;} along their boundaries by the words 
(If p; is the empty word then de, is attached to v.) Then 7 K(p) 
is the group presented by p. 

Conversely, if K is an oriented 2-complex in C, a group presentation 
p(K) is induced, which is unique up to indexing of the {x} and {r,} and 
cyclic permutation of the {p;}. 
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Remark 1. If i #4 j, then r; and r, are distinct relators, even if 
Pp; = P;+ For example, let p, = ix,|r,} and p, = {x,|s,, s,}, where the words 
associated with r,, s,, s, are all x). Then p, #P» and K(p,) isa 2-cell 
while K(p ») is a 2-sphere. We shall generally abuse our notation when no 
ambiguity is present, and write p, = {x,|x,, x,}; that is, we shall use p; 
instead of r, in describing the presentation, suppressing (but not forgetting) 
the indexing of the relators. 

Remark 2. Cancellation of adjacent inverses within a relator, taken for 
granted in word operations, will not be allowed here. For example, if p, = 
{x| D} and p, = 1}, then K(p,) = S' vs? but K(p) is a pinched 
We shall show later that cancellation corresponds to a formal 3-deformation. 

Remark 3. Each relator word p is assumed to be written as a noncollect- 
ed word in the generators and their inverses; that is, p = itue should be 
written x)%)* xx, In constructing K(p), the corresponding 2-cell may 
have some boundary edges which are identified to v, as long as the remain- 
ing edges, taken clockwise from some point, read the word p. The insertion 
of edges to be identified with v does not change the homeomorphism type of 
K(p) and corresponds to insertion of the identity element of F(x), pinata x,) 
at various places within the relator word p. 


5. 2-dimensional operations. On a presentation p = x 


r,}, define the following operations: 

(1) Cyclically permute the letters of any p;. 

-1 

(2) Replace p; by 

(3) Add a generator @ and a relator (whose word is) Aw, where w is 
a word in X, (possibly 2). 

(4) Delete a generator @ and a relator w, provided that a does not 
appear in any other relator or in w. 


Of these operations, only (3) and (4) alter the homeomorphism type of 


K(p). 


Theorem 1. K* formally 2-deforms to L? in C if and only if p(K) can 
be transformed to p(L) by operations (1), (2), (3), (4. 


Proof. Since there are no 1l-deformations in C, it suffices to consider 
a single elementary 2-expansion or collapse. A 2-expansion K/L consists 
of adding a l-cell @ anda 2-cell e whose boundary is attached via the 
word Qw, where w is any word in the l-cells of K. By performing (3) on 
p(K), followed by (1), (2), if necessary, we obtain p(L). A 2-collapse K\L 


corresponds to (4); there must be a free edge @ through which to collapse 
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a 2-cell e. In p(K) @ appears once in the relator r corresponding to e, 
and in no other relator. Say r= waw'. Apply (1) to get aww, then (4) to 
delete the generator @ and relator aw'w. Follow with (1), (2) if necessary. 

Conversely, each operation on a presentation p may be realized on 
K(p) as follows: for (1), (2), do nothing to K(p); for (3), expand; for (4), 
collapse. 


6. The 3-dimensional operation. A 3-deformation between K? and L? 
in C will be called transient if each 3-expansion is followed immediately 
by a 3-collapse. There is no accumulation of 3-cells in a transient defor- 
mation. Lemma 2 shows that we need devise a presentation operation for 
transient 3-deformations only. 


Lemma 2. If K? 3-deforms to L? in C, then K* transiently 3-deforms 
to L? in C. 


Proof. Let a 3-deformation D be given. Enumerate the 3-cells E,, 
-++, E, in the order in which they appear in D, and let F; denote the face 
through which E; is eventually collapsed. 

Construct a transient deformation D’ in the following manner. When 
E, is attached in D, let it be attached in D’ but immediately collapsed via 
F,. When E, is attached in D, let it be attached in D' such that any faces 
which were oedial to F, in D are now subdivided and attached to dE, - 
F, instead, via some induced by F, CE,NOE, - F.. The 
must now be free: this fails only if, in D, F F,Cd0E,, 
which is impossible since it would block the sien of both E, and E, 
in D. Collapse E, via F, 

In a similar fashion, let each subsequent 3-cell E, be attached in D’ 
via the composition of its attaching map in D and the maps ¢,_,,--+, $y» 
then collapsed immediately via F;, which must be free or else there would 
exist a circle of inequalities F; C dE, dE, COE,, 


blocking the collapses of E,, E, ,...,E&, in D. 
1 m 
We shall now describe an operation on a presentation {x,|7,} which 
corresponds to an elementary transient 3-deformation K? 7H>N\L2, 
A word p in Kipeeey X, will be called allowable if it is obtained by 
the following steps: 


(0) Beginning with the empty word, successively insert words of the 


form xx~! or x~'x at any point in the word, where x is any generator. Call 


this word s. 
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(1) Choose any relator r,, and let p; be any cyclic permutation of p;. 
Let s’ be any cyclic permutation of s. 

(2) Form the product s'p, 

(3) Optionally perform any cancellations induced by juxtaposition of 
s’ and 

(4) Call the new word s again, and iterate steps (1), (2), (3). 

Operation (5). If p is an allowable word in ix} and if r, is some re- 
lator which is used exactly once in constructing p, change p, to p™ ', 

To see that (5) corresponds to an elementary transient 3-deformation, 
list the relators in the order in which they were used in constructing p, say 


To 


In S*, construct a tree t whose edges read counterclockwise (from 
- t) the word s of step (0). Construct a 2-cell ei whose boundary edges 


read p, and whose intersection with ¢ corresponds to the cancellations 
1 


(if any) in step (3), so that the word read counterclockwise from S? - 
(tue, > is the word s of step (4). (If Pi, = Z, let ei, have one boundary 
edge labelled v.) 

Modelling on operation (5) we construct in this fashion a collapsible 
cell complex t Ve; ‘ ++. Ve, in S*, and the word read counterclockwise 


from the annibines is the wen p- Let e denote the complementary 2-cell; 
its clockwise boundary word is p on, 

Attach B? to K(p) using this subdivision of s*, by mapping each ver- 
tex of S* to v, each edge to the l-cell or vertex of K(p) whose letter it 
bears, and each open 2-cell e,- homeomorphically to its counterpart in K(p). 
This move is an elementary expansion, of which e is the free face. 

Let e, be the 2-cell of K(p) corresponding to 7,. Since r, was used 
exactly once in constructing p, e, is a free face of the new 3-cell. Col- 
lapse the 3-cell via e,. This transient 3-deformation realizes operation (5). 

Conversely, a 3-deformation K7 KU ;BPNL. p(K) = 
tix, j|{r,}}. The expansion is accomplished by anntien S?_é to K, where 
e is some 2-cell in some cell subdivision of S*. Let p7! be the word read 
clockwise from Bd e. Then S?-@ isa collapsible complex whose boundary 
word (read counterclockwise from e) is p. Collapse the 2-cells of S 7 .¢ 
in any order and let t be the remaining tree. Each edge of t is mapped by 
{ to some I-cell x; of K. Expand from any vertex of ¢ to ¢ itself; this in- 
duces step (0) of operation.(5). The 2-expansion t 7S 2 _ @ induces steps 
(1), (2), (3) for each 2-cell in the expansion. As a result, the word p is 


n 
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built up in an allowable fashion from the presentation p(K). If e, is the 
free face in the collapse K uv ,B°NL, it must follow that r, was used ex- 
actly once in constructing p. Apply operation (5) to replace the relator word 
P, by p™ 1. This operation realizes the transient 3-deformation. 

The following theorem has now been established. 


Theorem 2. K? formally 3-deforms to L? in C if and only if p(K) can 
be transformed to p(L) by operations (1) through (5). 


7. Consequences of the operations. The following operations can be 
performed as a composition of operations (1)—(5). 
Cancellation. Suppose some relator r has associated word p = uxx~!v, 


where uw and v are words in ix, }. We may replace p by uv by the operations 


-1 


2, ax~}} 4, fa|w, 


4, 


Co;jugation. To replace p by g™ oe, where g is any word in ix}, do 
repeated applications of the sequence 1 ox. 

Forming products. If r;, r, are relators and i # j, we may replace p; 
by P;P; by 


5 2 


It is necessary for operation (5) that i # j, to ensure that 7; is used exactly 
once in constructing p,p,. 


8. Generalization to polyhedra. It is desirable to generalize Theorem 2 
to a theorem about polyhedra. The necessary ingredients are the representa- 
tion of polyhedra by elements of C, and the invariance of 3-deformation 
classes under this representation. 

The first generalization is to cell complexes. If K is any cell complex 
and T is any tree in K which contains all vertices, then K/T € C, 


Lemma 3. K? formally 3-deforms (through cell complexes) to K/T. If 
To» T, are trees in K, then K/T, 3-deforms in C to K/T }. 


Proof. Let K x1 have the product structure. Then (K x I)/(T x1)\ 
(K x1)/(T x1) =K/T. Also 


(K x x x O)U(T x DAT x I) NK x 0, 


| 
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since T\0. Thus K 3-deforms to K/T, 

Let v be any vertex of K. Let T =(T, x 0) U(vx 1) U(T, x 1). Then 
K x I\(K x 0) UT by collapsing K x! vertically to (K x 0) v(T, x I), 
then collapsing T, x! horizontally to (T, x 0) U(T, x 1)U(vx I). Upon 
smashing T, we obtain (K x I)/T \(K x 0)/T, = K/T,. Similarly (K x I)/T 
NAK x 1)/T, > K/T 1 Since (K x I)/T has one vertex, K/T, 3-deforms in 
C to K/T,. 


Lemma 4. Let K* and L? be cell complexes and let K? 3-deform cel- 
lularly to L*, Let T and U be trees in K and L which contain all ver- 
tices. Then K/T 3-deforms in C to L/U. 


Proof. There is a cell complex H? such that K?/ H?\L*. The com- 
plex H? is obtained by reordering the 3-deformation from K to L so that 
all expansions occur first. 

Let T, = TU (trail of vertices in H?\K*) and U, = UU (trail of ver- 
tices in HL”). Now T, contains no free edges of HK, so this col- 
lapse induces a collapse H/T K/T in, C. 


Let X* be the 2-complex which remains after collapsing the 3-cells 


in HNL. Then T, C X, and H/T,\.X/T, in C. By Lemma 3, X/T, 3- 
deforms in C to X/U,, which in turn collapses to L/U in C. 


Lemma 5. Let K? be acell complex and let K' be acell subdivision 
of K. Let T and T' be trees in K and K' containing all vertices. Then 
K/T 3-deforms to K'/T' in C. 


Proof. Let K x 1 have the product structure induced from K, except 
on K x 1 where the structure is induced from K’. Then K@KxO0/KxIN 
K x 12K’ as cell complexes, and by Lemma 4, K/T 3-deforms to K'/T' 
in C. 

For an arbitrary compact connected 2-polyhedron P, a representative 
P of P in C is obtained by triangulating P in any fashion as a cell com- 
plex and smashing any tree containing all vertices. A presentation induced 
by P is any presentation p(P), where P is a representative of P in C. 

Theorem 3. The following are equivalent: 

(i) The polyhedron P? formally 3-deforms (polyhedrally) to the poly- 
hedron 
(ii) For some representatives P, 0 in C, P 3-deforms to O inc. 
(iii) For all representatives P, Q in C, P 3-deforms to O in C. 


By virtue of Theorem 2, we obtain 
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Corollary 3.1. The polyhedron P? formally 3-deforms to the polyhed- 
ron Q? if and only if some (all) induced presentation(s) of P can be trans- 
formed to some (all) induced presentation(s) of Q by operations (1)—(5). 


Proof of Theorem 3. (iii) —+(i). Let P, O be representatives of P, Q 
in C. By Lemma 3, there exist (polyhedral) 3-deformations P ~P, 9—9Q, 
and by hypothesis, P 3-deforms to Q. Hence P 3-deforms polyhedrally to 
Q. 

(i)—(ii). If P? 3-deforms to Q?, there exists a polyhedron Z? such 
that P/Z\Q. There exist simplicial triangulations H, K, L of Z, P, Q 
such that K/H\L simplicially. (These may be obtained by triangulating 
Z, subdividing to get a simplicial collapse to P, subdividing further to get 
a simplicial collapse to Q, and invoking [2] to see that the simplicial col- 
lapse to P is not lost.) Since K 3-deforms to L simplicially, Lemma 4 
states that for any representatives P, Q of the form K/T, L/U (for these 
particular K, L), P 3-deforms to Q in C. 

(ii) (iii). If K/T and K'/T' are representatives of P in C, then K 
and K’ have a common (up to isomorphism) subdivision K". Let T” be any 
tree in K" containing all vertices. Then by Lemma 5, there are 3-deforma- 
tions K/T—K"/T" — K'/T’ in C. Hence if P 3-deforms to 0 in C for 


some representatives, the same is true for all representatives. 


9. Simply connected complexes. If K € C has 7,(K) = 1 then in p(K) 


= ix,, x the normal closure of r),..., in the free group 
F(x,,.++,%,) is the free group F(x,,..., x,,). With this extra condition, 
the operations (1)—(5) can be simplified to these: 


(0) Cancellation (and its inverse). 


(i) Replace r; by 
(ii) Replace r, by rtp it je 
(iii) Replace r; by g~ g € 
(iv) Add a generator x and a relator x. 
(v) Delete a generator x and relator x if x appears in no other re- 
lator. 

It is easily seen that operations (1)—(5) imply the new operations. The 
converse is also true, and only (3) and (5) present any difficulty. To ob- 
tain (3), write w as a product of conjugates of the relators, then add 
{a|a} and apply (ii) and (iii) repeatedly to change the relator a to aw. To 
obtain (5), let w be the word built in the process of constructing p just prior 
to the usage of the relator r,. Since w is a product of conjugates of the 


other relators, we can replace p, by wp,. Then p is constructed without 
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using 7, again, so we may replace wp, by p, then p7! to get (5). 
From the foregoing and Corollary 3.1 we have 


Corollary 3.2. P* formally 3-deforms to an n-fold wedge of 2-spheres 
if and only if all presentations induced by P can be transformed to the 


presentation with no generators and n empty relators by the operations 


(0), (i),..., (v). 


When n = 0, this says that contractible 2-polyhedra 3-deform to a 
point if and only if their induced presentations can be transformed to the 
empty presentation { | } by those operations. 
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ABSTRACT. Let ly, be a sequence of functions, y, € MI. > E, where 
S is a nonempty subset of the /-dimensional Euclidean space and E, is an 
ordered vector space with positive cone K.. If € Nl sufficient con- 
ditions are given that ly, } have a subsequence thy} such that for each t €S 
the sequence th, (0)} is monotone for k sufficiently large, depending on ¢. If 
each E_ is an ordered topological vector space, sufficient conditions are 
given that ly, ! has a subsequence th} such that for every t €S the se- 
quence th (2) is either monotone for & sufficiently large depending on ¢, 
or else the sequence th ,(0)} is convergent. If E,= B for each s and Ba 
Banach space then a definition of bounded variation is given so that if ly, 3 
is uniformly norm bounded and the variation of the functions y, is uniform- 
ly bounded then there is a convergent subsequence {h,| of ly,}. In the case 


E, = E for each s €S and E is such that bounded monotone sequences con- 


verge then the given conditions imply the existence of a subsequence th, I 
of ly,! which converges for each t €S. 


1. Introduction. The terminology used in this paper relating to ordered 
vector spaces will agree with that of Peressini [10] unless stated otherwise 
or explicitly defined. In particular, the definitions of ordered vector space 
E, positive cone K of E, ordered interval [a, 6] in E where a< b, ordered 
bounded subset of E, majorized subset of E, ordered topological vector space 
E, ordered locally convex space E, and normal positive cone K of a topolog- 
ical vector space E agree with [10]. An ordered Banach space B will be a 
Banach space which is also an ordered vector space and thus is an ordered 
topological vector space. We note that we do not require the positive cone 
K of a topological vector space E to be closed as is done, for example, in 
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Shaefer [16]. The /-dimensional Euclidean space R! will be considered with 
the usual norm unless otherwise stated, the open sphere will be D(z, 5) = 

{x € R!: \\t ~ xl] <5} with center ¢ and radius 8 and the order will be deter- 
mined by some positive cone 


Q, = f(x), x (2), x); x) > 0, x> 0 for t= 0, 0 for 
t,= lwhere k= + 2t,+ 20°?) _ 


1<k<2'-!, 


The interior of the positive cone will be 


= x, x): «> 0, «> 0 if t,=0, «<0 if t,=1 


for k= 1+t, + 2t,+ 
The translate of any /- 1 dimensional subspace will be called a hyperplane 
in R! and if it is of the form {(a", af?) ,,, . a): a. © for i fixed and 


some constant c} it will be called a regular hyperplane. A closed interval 
will be 


I=[a, B) xD), al) <x) < BM, Ik 


where a = (a"!), a2), all), B= B®,..., and a) < 
for i= 1, 2,..., The vertices of | will be ix), where 

a® if t.=0, 
D, 

if t,=1, 


x, = ly 


The set {(y"!), y),..., y): y™) = for m fixed and < y)< BY 
for i # m} will be called a minimum bounding edge of I and {(y!, y"?),..., 
y): y™ = B™ for m fixed and a) < y) < B® for i¢ m} will be called 
a maximum bounding edge of I. 

Two elements x, and x, in an ordered vector space E with positive 
cone K will be comparable if x, ~ x, € K or x,— x, € K holds. By a mono- 
tone nondecreasing sequence ix, } in an ordered vector space E we mean 
K holds for all k. A monotone nonincreasing sequence is simi- 
larly defined and a sequence is called monotone if it is either monotone non- 
decreasing ot monotone nonincreasing. 


and 
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A sequence {x,} in an ordered vector space E will be said to be even- 


tually monotone nondecreasing if there exists an integer ky so that x, ,,- 


x, € K holds for all k > k,. An eventually monotone nondecreasing sequence 
is similarly defined and a sequence is called eventually monotone if it is 
either eventually monotone nondecreasing or eventually monotone nonincreas- 
ing. 

If ty, 3 is a sequence of functions, y, €Il,.~E, where S is a nonempty 
subset of R! and E = iS an ordered vector space with positive cone K, then 
we say that the sequence ty, 3 is a monotone nondecreasing sequence of func- 
tions on S if the sequence ty,(s)} is a monotone nondecreasing sequence in 
E, foreach s€S. A monotone nonincreasing sequence of functions on S is 
similarly defined and a sequence of functions is said to be monotone on S if 
it is either monotone nondecreasing or monotone nonincreasing. 

If ty, 3 is a sequence of functions, y, €Il,.,E,, where S is a nonempty 
subset of R! and E., is an ordered vector space with positive cone’ K, then 
we say that the sequence of functions {y,} is an eventually monotone nonde- 
creasing sequence on S if {y,(s)} is eventually monotone for each s € S. 

Let ly, be a sequence of functions, y, € fl, .,E, where S is a nonemp- 
ty subset of R! and each E, is an ordered vector space. Sufficient condi- 
tions that have a subsequence th} such that for each s € S, th, (s)} is 
eventually monotone in E. are given in Theorem 4.1. In case each E, isa 
sequentially complete ordered locally convex space, Theorem 4.4 gives suf- 
ficient conditions that there be a subsequence {h x} of fy RS such that for every 
s €S the sequence th, (s)} is either eventually monotone or else convergent 
in E.. Additional hypotheses are given in Theorem 5.1 to insure the existence 
of a subsequence {h,} of fy,} such that {h,(s)} converges in E. for each 
s €S. This generalizes the results in [15] and gives, in Theorem 5.4, a nec- 
essary and sufficient condition that a sequence of functions from a subset of 
I-dimensional Euclidean space into q-dimensional Euclidean space have a 
subsequence that is pointwise convergent. 

For ty, 3 a sequence of functions, y,: S + B where S is a nonempty sub- 
set of R! and B is an ordered Banach space, a definition of variation is 


given in $3 so that Theorem 5.2 yields a generalized Helly selection theorem 
as a Corollary. 


2. Preliminary results. We will refer to a result of Ramsey [11, Theorem 


A, p- 264] or [12, Theorem A, p. 82] repeatedly so we will include its state- 
ment here. 


Theorem 2.1. Let I be an infinite class, u and r positive integers, 


and let those subclasses of T which have exactly r members, or, as we may 
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say, let all r-combinations of the members of T be divided in any manner in- 
tou mutually exclusive classes €, (i= 1, 2,..., u), So that every r-combin- 
ation is a member of one and only one C;. Then, assuming the axiom of se- 
lections, T must contain an infinite subclass A such that all the r-combin- 
ations of the members of A belong to the same C,. 


Corollary 2.2. Let J be a nonempty subset of R! and if, } be a sequence 
of functions, f, € Tey E, where each E, is an ordered vector space with pos- 
itive cone K,. If [,(t) and AO) are comparable for each t € J and k, j= 
1, 2,..+, then either there is a subsequence th} of {/,$ such that th} is a 
monotone subsequence on J] or else there is a subsequence ths of if, such 
that if i# j there are t,t € J depending on i, j with h{t)- h {t) € K,, ht) 


The proof of this corollary follows in a similar manner to that of Corol- 
lary 2.3 in [14]. 


Corollary 2.3. Let J be a nonempty subset of R! and if, be a sequence 
of functions, {, € ll, eJ E , where each E, is an ordered topological vector 
space. If W, is a circled neighborhood of 6, in E, then either there is a sub- 


sequence of {{,} such that for i # j, —hft) €W, forall t €J or 
else there is a subsequence th of \f,$ such that for i # j, h {t) -h{t)¢ W, 
for some t € J] depending on i, j. 


The proof of this corollary follows in a similar manner to that of Corol- 
lary 2.3 in [14]. 


3. Variation. In [14] where sequences of functions from the real numbers 
into the real numbers were considered, a result yielding the Helly selection 
theorem as a Corollary was given. Then in [15] where the functions were from 
the real numbers into ordered Banach spaces, a generalized Helly selection 
theorem was given as a corollary. Browne [1] considers functions from /-di- 
mensional Euclidean space into the real numbers and with one definition of 
variation gets another generalized Helly selection theorem. Four definitions 
of variation are given here and their relationship considered when the func- 
tions are from /-dimensional Euclidean space into an ordered Banach space. 

Consider the interval =[a, B] CR! and a, b €1 with <b for 
i= 1, 2,..., /, then J =[a, 6) will be a subinterval of I. A subdivision of 
[a, A) will consist of a finite number of subintervals Tyo Tyeeeee Iq OF I 
such that Uz, J, = 1 and for k#j, J,2 J; is either empty, a point, or is a 
p-dimensional interval where 1< p</-— 1. A refinement of the subdivision 


{J 1» J++» J,,$ will be a subdivision obtained by subdividing one or more 
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of the J ,’s into two or more subintervals. A subdivision {J,, J---» J,,3 
will be called regular if all of the minimum bounding edges of J, =[a,, b 1, 


and the maximum bounding edges of J_, 
for n= 1, 2,..., m are extended to 


7, YP a cy BO for id jh, 


respectively, and the subdivision is not refined. A set X= ix, =O, X>, %3, 
++ %,_y *, = B}C1=[a, B] will be called a partition of I, The subdivi- 
sion whose bounding edges are formed by the intersection of | with all the 
regular hyperplanes through ix, Xoreees x} will be called the subdivision 
determined by the partition ix), Xoreees xt. The set of vertices of all the 
subintervals of a subdivision Jy Jareees Jin’ will be the partition deter- 
mined by the subdivision. A partition X will be called regular if the set of 
vertices of the subintervals in the subdivision determined by X is again X. 
A partition X, will be said to be regularized to X if X consists of the ver- 
tices of the subintervals in the subdivision determined by the partition Xp. 

For a function /: 1+ B where B is an ordered Banach space, | =[a, f] 
CR a = (a, a), B= (8, B,..., BM) and al < BH 
for i= 1, 2,..., / consider the following definitions of the variation of f on 
I. 

Definition 3.1. Let X ={x,, x,, ..-,x,} be called an allowable parti- 
tion of I if X is such that Q; for k= 1, 2,...,”2-1, Q; isa 
fixed positive cone and x, is the smallest vertex of | and x, is the largest 
vertex of | as determined by Q:. The variation of / on I, denoted by VAG N, 
is given by 


n-1 


X k=l 


where the supremum is over all allowable partitions X ordered by a positive 
cone Q; for j= 1, 2,00, 2'-1. The function { will be said to be of bounded 
variation, denoted / € BV,, if VG 1) < +00, 
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An interval I = [a, B] C R! with the operation * given by 


x xy =(maxix"), yO}, max{x"), maxix™, y}) 


forms an idempotent semigroup with identity @. For x € I, the conventions 
x! =x and x° =a will be assumed. Thus a special case of the definition of 
variation given in [9] is given in the following: 

Definition 3.2 (Newman). Let T,, denote the Boolean algebra of all n- 


tuples of zeros and ones. Let 0,7 € be such that if > for 


i= i. 2, 0005 8 and 
(- 
7) = 


0, otherwise, 


where |a| denotes the number of ones in the n-tuple 0. Then for X = ix), Xos 
see x! any partition of | with x,=% and x, = B define 


L(x, of = plo, 
i=1 


TeTn 


where I] is the product under the operation * making | an idempotent semi- 
group. Then the variation of f on I, denoted by V,(/; I), is given by 


X oeT 
where the supremum is taken over all finite partitions X of I. The function 
{ will be said to be of bounded variation, denoted f € BV ,, if Vi(f; 1) < +00~ 
Definition 3.3 (Arzela). Let X = ix), Koseees x} be called a permissible 
partition of I if X is such that x, x, =f and x,,,-x, €Q, for k= 
1, Then the variation of f on I, denoted by V 305 I), is given 
by 
1 


V3; I) = sup -{(x,, 


X 
where the supremum is taken over all permissible partitions X of I. The 
function { will be said to be of bounded variation, denoted f € BV ,, if 
1) < +00, 
Definition 3.4 (Lebesgue). Let J =[a, b] be a subinterval of J and 
f{(x™, x1) x (tl), x) 


— f(x), a‘), x) 
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for r= 1, 2,..., / and =A,A,--++A,f. The variation of on I, denoted 
VG; D, is given by 


Z JeZ 
where the supremum is taken over all subdivisions Z of I. The function / 
will be said to be of bounded variation, denoted / € BV, if V,(f; I) < +0. 

If X ={x,, x,..-, x,} is a permissible partition for the calculation of 
V30;5 I) it is also an allowable partition for V,(/; I) so the calculation of 
V,(/; 1) is the supremum over a larger set than is the calculation of V,(f; I). 
Thus / € BV, implies that / € BV,. The converse of this statement does not 
hold however. Consider the function /: 1 > R, 1=[0, 1] C R? defined by 


sin(1/x) if x+y=1, 
{(x, y) = 
> otherwise. 
Since sin(1/x) is not of bounded variation on [0, 1] CR, f(x, y) is not of 
bounded variation by Definition 1. However any partition ordered by Q, con- 
tains at most one point where /(x, y) is nonzero so that V3; N<2. 

To determine the relationship between V,(/; /) and V,(/; I) some pre- 
liminary results are necessary. In the calculation of V,(/; I) the elements of 
T, will be denoted a‘ 1)_ (1) and of?) (0). Assume that the elements rs 
have been then of T,, will be given by fl) 

= = 1) for k= and of) = (lm), 
for k= 2m where k= 1, 2,..., 2". The ith coordinate of otk) will be de- 
noted oi), The subscript ” will be deleted from _ when it is clear that 
ob eT. 

Note 1. Let f: 1+ B, 1=[a, B)CR! and X ={x,, x,,..., be the 
vertices of with x, = a, 8 and x,= where 


a’) if 0, 
(i) 
B® ift;=1 

for i= 1, 2,002, and k= 140, + 2t, Then LX, 02? 
= Ajl where Ajl is as in Definition 5.4. 

Proof. Let 


k k 20 
(i) 
(1) : op IT =X 


i=1 


™m 


= 
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for m= 1, let be such that for all 
eT, and let = o2(2'=1). Since = 0 for k> 2°2/-)) and 1, 
we have that p(n, o'*)) = 0 for k> 2° 8), 


2! 21 
i=1 i=1 


2! 
+ > > pln, o 


Hence it will suffice to show that 


2! 


i=1 


where is the number of t = 1 for m=1+ ty 

For = 1, 2,00, n= 0, 2! let , n) be the 
number of elements € such that p(n, o'?)) and of? Xa) = 
1 for values of i# 1. The number "of i#1 such that o'?m i) = 1 is 


- 1 and n) is the number of elements o such that u(y, 
0 for = 0, Thus N(O, 0)= 1 and 


24m -1 
N(d@_, n) -( )- 1 - 1,2) - ( Nd, - 2, n) 
d 


for n< _ 1 and N(d_, n)= 0 for n> 2°" _ 1, Now suppose > 
and contains n+ 1 ones so that p(y, o*)) = (-1)". Hence the note will hold 
if 


2l-1_1 2l-1 


j=0 j=1 


for d_ = 0,1, 2,...,/ since then (2) is true. 
For d= 0 it holds. Assume that (3) holds for d, <r- 1. Then for 


m 


(3) 
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2(2!-1)_1 


> N(r, Nr, 27 - 1) 


2’ -1 r ; r P r ? 

- r\,, r 
-1,2j-1)- (5) - 2, 3-1) 
r r-1 r tT 1 


where we define 


Thus we have that 
r-1 = r 1 r r r 
-r(- 1) - 1=-[(-1) + 1-1=(-) 


so the desired result holds. 

Note 2, Let f:1 +B, 1=[a, B]CR! and let X={x,, be 
the vertices of numbered as in Note 1. For as in (1), ofPm) 
for all o*) € we have that = A jim Where I, is the 
interval whose vertices are ix,: x, € Q, 

Proof. By definition 


We need only consider those of*) > o'?m) since ula'?m), = 0 otherwise. 
l k 

The set {x : x} for some > g'?m) = —x, 

Now let 


(Pm) 
Xs T and o*)>@ Om 


By a counting argument similar to that in the proof of Note 1 we have that 


j=0 
j=l 
21 
A. II 
i=1 
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21 
II 44 ( x) 


i=1 


> plo?™?, 


ofkea, 


where and d_ are the number of such that x) in x, and x 
respectively. Thus L(X, = 

Note 3. Let +B, 1=[a, B]CR! and X={x,, x,,..., with X 
the vertices of | numbered as in Note 1. For I’), as in (1) and om) € pe 
> for all € we have that L(X, o*))f = 0 for k# 


2! 
i=1 


2! 2! 
> plo, oI bn who, 
=1 


o€P'm(1) =1 


21 
save 


such that x,, — € Q, for i=1,2,.0.,5- Now uo, of 


contains 2’ nonzero summands where r is the number*of i’s such that 
— gi) = 1 and of them are such that plo”, o) =+1 and 


(i), o) =-1. Hence 


2! 
“(0 = 0. 


i=1 


are such that plo 


Also ulo™, contains 2° summands where s is the 
m 

number of i’s such that ofm(k))(;)— oi) = 1 and again 25~! of them are such that 

o) =+1 and are such that o)=-1 so that 


Tr 
> o)f -0 
i=l 

and the conclusion holds. 


Lemma 3.5. Let {: 1+ B,1=[a, B] CR! and X= x, be 
the vertices of I with x, = and x17 B. Then 


JeQ 
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+ + 
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Proof. By definition 


2l 


oeT n=1 (Dm) 


2! of 


By Note 3 L(X, o*))f = 0 for k# b,, for some m so that 


2! 
o€T>] m=1 
(Pm))f — 
But by Note 1, L(X, 0 Y= Al and by Note 2, L(X, o‘?m’)f = Adin so 
the lemma holds. 
The following lemmas yield the equivalence of V,(/; I) and V,(f; I) pro- 
vided V,(/; J)=0 for J €Q. 
Lemma. Let {:1 +B, 1=[a, Let X= {x 5, be par- 
tition of I and X. = X Uly}, y ¢ X, be a second partition of I. Then 


L ols ofl. 


| 
This lemma follows since L(X, o*))f = L(X f+ L{x), ry where 
i) for i< m, 


r (i) = {0 for i= m, 
for i>m, 


for i#m, 


1 for i= m™. 


Lemma 3.6. Let /: 1+ B, 1=[a, R! and X= ix), x} bea 
regular partition of I with ul, Toneees I} the corresponding regular subdivi- 
sion of I in the calculation of V ,(f; 1). Then 


s 
oeT, m=1 
assuming the variation, V ])=0 for J €Q. 

The proof follows in a manner similar to that of Note l. 


Lemma 3.7. Let {: 1+ B, 1=[a, B] CR! and J)=0 for J €Q. 
Then { € BV, if and only if f € BV,. 


and 
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This follows from lemmas above. 

It remains to establish a relationship between V, and either V, or V,. 

Note 4, Let {:1+B, 1=[a, BJCR‘, f € BV, and V,(/; I)=0 for J €Q. 
Then € BV,. 

Proof. From Lemma 3.7, BV, and BV, are equivalent when V,(/; J) = 0 
for J €{. The calculation of V, is symmetrical and the calculations of V, 
and V, agree when the partition is ordered by Q, so the result follows. 


The converse of Note 4 does not hold. Consider the function /: | + R, I= 
[0, 1] C R? defined by 


| 0 otherwise. 


For N any positive integer, the regular partition P = {(k/2", 1/2"): k, j= 
2%} we have that 


2N 2N 


j=0 k=0 


Hence V,(f; for N>2. 
On the other hand for any partition P € P,P the set of all finite nonemp- 
ty partitions linearly ordered by either Q, or Q,, we have V,(/; !)< 
[2(2") - 11(1/2%) < 2 since P contains at most 2(2")— 1 points of the form (k/2", 
j/2") with a total number less than or equal to 2(2%)-1 so that f € BV,. 
The example showing that { € BV, does not imply / € BV, also shows 


182 
ie hea i. 
y) = ((- 1)” f 
k+l (fk i+1\, i+] 
>F+ 2+ HN-2) 
since 
k i\jfe+1 i+] k+1 i\/pk 
and 
k i\;(e+1 
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then that / € BV, does not imply f € BV, or f € BV,. 


4, Primary results. We now address the question of rage conditions 
which when satisfied by the sequence ly} YR E Nl. es E,, where S is a non- 
empty set in R! and each E., is an ordered vector space, guarantee the ex- 
istence of a subsequence of ly,} which converges pointwise on S. With this 
in mind we make the following definition. 


Definition 4.1. Let S be a nonempty subset of R! and { be a function, 
fell 


K,. Consider the set P of all finite nonempty partitions P = ix), Kopeees x! 


ses E, where each E, is an ordered vector space with positive cone 


of S where n>1, x, €S for i= 1, 2,...,” and P is linearly ordered by 
some positive cone Q, for j= 1, 2,600, If f(s) # 6. for some s €S 
we say that (/, P) is proper pair if (-1 for i= 1, 2,000,” oF 
else (-1)'/(«,) < 6. for i= 1, 2,...,”. If f(s)= for all s €S we say 
that (/, P) is a proper pair if P contains exactly one point. 

We will say that the sequence is an eventually comparable sequence if 

there exists a positive integer M(t) such that y,(t) and y(t) are comparable 
for k, j > M(t). 


Theorem 4.2. Let S be a nonempty subset of R! and ly, } be a sequence 
of functions, y, Ell, ., E,, where each E, is an ordered vector space with 
positive cone K,. For each t €S assume that \y,(t)} is an eventually com- 
parable sequence and that there is a number 5(t)> 0 and positive integers 
N(t) and H(t) such that for each k, j > H(t) the partitions P €P such that 
Y,- yy P) is a proper pair, each contain at most N(t) points in the sphere 
Dit, d(t)). Then ty,} contains a subsequence {h,} such that {h,(t)} is even- 
tually monotone for each t € S. 


Proof. If y,(t) and y () are comparable for all k, j > M(t) and M(t) is 
the smallest integer having this property we let A, = {t: t € S, M(t) = i} for 
i= 1, 2,.+++ For any z €A; we have y,(t) and y(t) comparable for k, j > 
i. We will prove the theorem assuming that y,(¢) and y(t) are comparable 
for all ¢ € S and then a standard disagonalization argument where S is re- 
placed by A,, A,,+++ yields the desired result. 

We note that we may assume S is bounded because if the theorem is true 
for bounded sets a standard diagonalization argument with $M D(0, 1), SN 
D(0, 2),+++ yields the result for unbounded sets. Also, we may assume §S is 
a closed interval because if the theorem is true for closed intervals | = [a, A), 
then we may choose / to be a closed interval containing the bounded set S 
and define a sequence of functions {Z,}, Z, €ll, ., F, where F,=E, for 
s €S and F,=R (with the usual order) for s €1, s ¢ S, by 
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y,(t) for teS, 
Z(t) = 
for t¢S. 


Then the sequence {Z,3 satisfies the hypotheses of the theorem on / since 
for (Z, P) a proper pair either Z,(t)- Z(t) = 0 for all €1 or else P 
contains no points in I!— S. Also, since we may assume S is a compact inter- 
val there exists a finite number of ¢; €S, i= 1, 2,.+., m, such that D(t;, 
i<icn (H(t;)} and N = 

> N(t;) we have integers N and H such that for k, j > H the partitions 

P €f such that Y,- yy» P) is a proper pair, each contain at most N points 
in S. Hence without loss of generality we may assume H = 1. 


i= 1, 2,...,”, cover S and by choosing H = max 


The theorem will now be proved by induction on / for S a compact inter- 
val in 

Let /= 1, S be a compact interval and ly, 3 be a sequence of functions 
y, €ll, es E, where E, is an ordered vector space with positive cone K.. 
For each k, j and t € S assume that y,() is comparable with y;(t). Let N 
be a positive integer such that for each k, j the partitions P € P with 
(Yy,- y}? P) a proper pair each contain at most N points in S. The case for 
l= 1 will now be proved by induction on N. If N =1 then for each k, j either 
y,(t) _ y(t) € K, holds for all t € S or else yt) - y,(t) ca K, holds for all 
t €S. Thus by the mapping g, defined in the proof of Corollary 2.2, it is pos- 
sible to pick a subsequence of ly, 3 that is monotone on S. Now assume the 
theorem holds for N = 1, 2,..+, K. We will then show this implies it is cor- 
rect for N= K+1, 

If there are only finitely many functions in {y,} which are distinct on S$ 
then infinitely many are identical on S and using that as the subsequence we 


are done. Thus we may assume there are infinitely many functions in ty, 3 


which are distinct on S and, by picking a subsequence if necessary, we may 
assume all the y, are distinct on S. 

Let I, J be subintervals of S with !UJ =S,1M%J=9 and let I and 
] be of the same length. We will show that there is a subsequence of ly,} 
that is eventually monotone for each t €1 or else is eventually monotone for 
each t € J. Now let T= ly,},u= K+1 and r=2 with C, = y 
proper pairs (y, - y; P) are such that P has at most one point x € 1}. Now 
for n= 2, 3,006, K+1 let C, ={ly,, y k # j, proper pairs P) 
are such that P has at most n points x,, x,,---, x, €1 and ly, yj ¢C, 
p=1, 2,...,2-— 1}. By Theorem 2.1 there is an infinite subclass A of T 
such that all pairs of elements of A belong to the same C, for some m= 
1, 2,66, K+ 1. If m=1, 2,..., K then the induction hypothesis holds on 


-?’ 
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I and there is a subsequence th 3 of ty, that is eventually monotone at 
each point of I. Note that if fy,, y;3 €C_ then proper pairs (y, - Yi P) are 
such that P has at most K+ 2—™m points Xx47_,, €J so that 
if m= 2, 3,..+, K a similar argument shows that the induction hypothesis 
holds on J so there is a subsequence ig} of th 3 that is eventually mono- 
tone at each point of | UJ =S and the case /=1 holds. If m= K+ 1 then 
the proper pairs (y, — y,, P) are such that P has at most one point x € J 
and there is a subsequence th 3 of ly,} that is eventually monotone at each 
point of J. In any case either the case / = 1 holds or there is a subsequence 
that is eventually monotone at each point of I! or J. Let S, denote the inter- 
val I or J on which th 5} is not known to be eventually monotone at each 
point. 

We now repeat the entire process described in the preceding paragragh 
on S, obtaining S5, then on S, obtaining S;, etc. If the theorem does not 
hold at any step in the induction, use the standard diagonalization argument 
to obtain a sequence th te Let x, be the unique limit point of the set of mid- 
points of the intervals S|. Choose ig} to be a subsequence of th 3 such 
that {g,(x,)} is monotone so {g,} now has the property that it is eventually 
monotone at each’point of S and the case for /= 1 holds. 

Assume the theorem is true for /= L— 1 so it remains to show that it 
holds for /= L 

Let S = [a, be a compact interval in and be a sequence of 
functions, y, € ll, ., F,, where each E, is an ordered vector space with pos- 
itive cone K.. For k,j and t assume that y,(t) is comparable 
with y(t). Let N be a positive integer such that for each k, 7 the partitions 


P ef with y, —Yy P) a proper pair each contain at most N points in S. 


Now the case for /= L will be proved by induction on N. If N = 1 then for 
each k, j either y,{t)- yt) € K, holds for all ¢ €S or else y,{t) € 
K, holds for all ¢ € S. Thus it is possible to pick a subsequence as in the 
proof of Corollary 2.2 which is a monotone sequence on S. We now assume 
the theorem holds for N = 1, 2,..., K and will show this implies it is cor- 
rect for N= K+ 1. 

If there are only finitely many functions in ly,} which are distinct on S 
then infinitely many are identical on S and we are done. Thus we may assume 
there are infinitely many functions in ly, 3 that are distinct on S and, by 
picking a subsequence if necessary, we may assume all the y,’s are distinct. 
Let I, J be subintervals of S with 1UJ =S,IN J l=la,y,]-Xy J = 
ly,, where y, = B), B®,.. , B), 4 p™), 
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< B™ for i= 2, 3,.++, L}. We will show by the same argument as for / = 1 
that there is a subsequence of ly, that is eventually monotone for each ¢t € 
I or else is eventually monotone for each t € J. Since all y,(B) are compa- 
rable there is a subsequence of ly, }, denoted again by ly, |, such that ly ,(B)} 
is monotone. Now using Theorem 2.1 with T = ly, u=K+1 and r=2 
where C, = Ily,, y i: k # j, proper pairs (y, - yi P) are such that P con- 
tains at most one point x € and C= ily, y k # j, proper pairs 
Yi P) are such that P has at most ” points x,, x,,---, x, €/ and ly,, y;} 
¢ Cop p=1, 2,..., 2-1} for n=2,..., K+1 there is an infinite subclass A of 
I’ such that all pairs of elements of A belong to the same C_, for some m= 1, 2,.+6, 
K+1. If m=1, 2,..., K then the induction hypothesis holds on | and there is 
a subsequence th 5} of ly, 3 such that th 3 is monotone at each point of I. 
Again if ly,, y,) €C,, then the proper pairs (y,-y, P) are such that P has 
at most K+ 2—™m points So if m= 2, K 
then the induction hypothesis holds on J so there is a subsequence ig} of 
th that is monotone at each point of | U J = S and the theorem holds. If 
m = K + 1 then the proper pairs (y, —Y} P) are such that P has at most one 
point x €J and there is a subsequence th} of ly, that is monotone at each 
point of J. In any case either the theorem holds or there is a subsequence 
that is monotone at each point of | or is monotone at each point of J. Let 
S, denote the interval I] or J on which th 5} is not known to be eventually 
monotone. 

Now repeat the entire process described in the preceding paragraph on 
S, to obtain S$, so that we obtain a sequence that is eventually monotone on 


(S - S,). Continuing, we repeat the entire process on S, to obtain S,, on S, 


to obtain Ss etc. If the theorem does not hold at any step in the induction, 
then by a standard diagonalization argument we obtain a sequence th that 
is eventually monotone on = (S - S;). But. rel S, isan L-1 di- 
mensional interval so by the induction hypothesis on the dimension of the do- 
main it is possible to choose ig}, a subsequence of th 3, such that ig (x)} 
is eventually monotone for x € pre S,. Now {g.} has the property that it 
is eventually monotone at each point of $C R" so the conclusion of the theo- 
rem holds. 

In the next theorem, by further restricting E., we obtain a subsequence 
th of iy, 3 such that th (s)} is eventually monotone in E. or else converges 
in E. foreach s €S. The proof will again be done by induction on the dimen- 
sion of the domain. The following is the case for /= 1. 


Theorem 4.3. Let S be a nonempty subset of real numbers and ly, 3 bea 


sequence of functions, y, € Il E ,, where each E, is a sequentially com- 


s €S 
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plete ordered locally convex space with positive cone K,. For each téS 
assume that ty, (e)} is an eventually comparable sequence. Assume E, has 
a nested countable basis of circled sets at 0, denoted by \U,(n)}. For each 
t €S and each positive integer n assume that there are nonnegative integers 
N(n, t), H(n, t) and a number 5(n, t)> 0 such that for all k, j > H(n, t) if 
(y,- yi P) is a proper pair then P contains at most N(n, t) points x such 
y,)- y (x) (n) and t - t)< x <t+ dn, t). Then ly,} contains a 
subsequence th 5} such that for each t €S, th (e)} is either eventually mono- 


tone or else is convergent. 


Proof. See note following Theorem 2.2 in [15], 
Now for the case / > 1 the following theorem yields the desired conclu- 
sion. 


Theorem 4.4. Let S be a nonempty subset of R! and ly, } be a sequence 


of functions, y, € I E ,, where each E, is a sequentially complete ordered 


séS 
locally convex space with positive cone K,. For each t €S assume that 
ly,(t)} is an eventually comparable sequence: Assume E, has a nesied 
countable basis of circled sets of 0, denoted by {U,(n)}. For each t €S and 


each positive integer n assume that there are nonnegative integers N(n, t), 


H(n, t) and a number (n, t)>0 such that for all k, j > H(n, t) if Y,- Yi P) 
is a proper pair then P contains at most N(n, t) points x such that y,(x)- 
y bx) ¢U,(n) and x is in the sphere Dit, 5(n, t)). Then ty,} contains a sub- 
sequence th,} such that for each t € S, {h,(t)} is either eventually monotone 
or else is convergent. 


Proof. As in the proof of Theorem 3.1 we may assume that y,(t) and 
y(t) are comparable for all k, j and t €S. Also we will again assume S is 
a bounded closed interval, § = [a, B] and H(n, t) will be replaced by H(n) 
and N(n) respectively. 

The proof now will be by induction on the dimension of the domain. The 
case for /= 1 is Theorem 3.2. Assume the result holds for / = K— 1 then 
we will show that the theorem is true for / = K. 

Let {J ,} be an enumeration of the spheres D(t, 5) CS in R¥ with ratio- 
nal centers and rational radii. 

Now for J, by Corollary 2.2 there is a subsequence of ly, 3; again denoted 
ly}, that is monotone on J, or else there is a subsequence of ly, 3 again 
denoted by ty, 3 such that for k # j, y,(t) > y(t) for some t €J, and y,) < 
y;) for some 7 € J,. Now repeat the process described in the preceding sen- 
tence for J,, J 3° ++ and then take the diagonal subsequence, denote it again 
by ly, }- This sequence has the property that on 3 it is either eventually 
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monotone or else for every k # j sufficiently large, depending on i, there 
exists t, 7 € J; such that y,{t) > and y,) <y,. 

Now using J, and U,(1) by Corollary 2.3 there exists a subsequence of 
ly, }, again denoted by ly,}, such that, for k # j, y,(t)- € U,(1) for all 
t € J, or else there is a subsequence of ly,}, again denoted by ly, 3, such 
that, for k #7 there isa ¢t € J, with y,{t)- y;@) ¢U,(1). Now repeat the 
process described in the previous sentence using U (2), U,(3),+++* and then 
take the diagonal subsequence and denote it again by ly, } This sequence 
has the property that for J, and U,() either for all & #j sufficiently large, 
depending on 2, y,(t)- y ;{t) € U {n) for all t € J, or else for all #j suf- 
ficiently large depending on 2, there is some t € J, such that y,{t)- y(t) 
¢ U {n). 

We now repeat the entire process described in the preceding paragraph 
consecutively on the spheres J,, J,,++* and then take the diagonal subse- 
quence again denoted by fy ,)+ This sequence has the property that for J, and 
U (2) either for k #j sufficiently large depending on i and 2, y,{t)- y;#) € 
U {n) for every t € J, or else for every k # j sufficiently large, depending on 
i and n, there exists a t € J; such that y,(t)- y;t) ¢ U,{n). 

Let I',,1T,,-+->T,% be the bounding edges of S; then T, isa K-1 
dimensional interval so by the induction hypothesis there is a subsequence of 
ly, }, denote it again by ly,}, such that for x €T’,, ly, (x)} is either eventually 
monotone or else is convergent. Then by similarly extracting a subsequence 
from on consecutively we obtain a subsequence that 
is either eventually monotone or convergent for each point of the bounding 
edges of S. 

Now suppose A, is the set of x’s in S such that fy,(x)} does not con- 
verge and is not eventually monotone. If A, is countable then by a standard 
diagonalization argument there is a subsequence of {y zi» denote it again by 
ly,}, that is either eventually monotone or else is convergent for each x € S. 
So suppose A, is uncountable. Let I be the set of K— 1 dimensional hy- 
perplanes of the form y = {(x!), x(2),..., x(K); x = ¢ for i fixed, a) < 


c < B“} which have nonempty intersection with A,- Consider the set V of 
sets B of the form 


2K-1 
yeTl, ay, U [o? u(-o% 


Now order the sets B in V by B, <B, if and only if B, CB,. Then the 

union of any linearly ordered chain in V is an upper bound of the chain and 

is again in so by Zorn’s lemma there must be a maximal element By in y. 
If By is uncountable and (y,, (y,, ay.) are in By then 
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€ fo? u (-0°)). Let A, ={a,: (y,a € B,}- Now for x €A, 
3 be the subsequence of { J; of the which 
Xe There must be a smallest positive integer 7, such that y,{t)- ¢ 
U (n, ;) for all k #7 sufficiently large, depending on i, for some t € F,; for 


otherwise fy ,} would be Cauchy on F,, and hence would be convergent at 


xi 
x which is contrary to the choice of x. If lim = +0 then there is a 
xi(a)! of in, such that lim, = +% and by the def- 
inition of n, and the nestedness of {U,(2)} we have that y,(t)- € 
Un, ia) - 1) for all k #7 sufficiently large, depending on @, and all t € 

F .i¢a)* This implies that ly, («)} is Cauchy and hence convergent which is 
contrary to the choice of x so that lim, 4..”,;=¢, <+o- Let c, <d, be an 


i--too 
subsequence {n 


upper bound for the set {n, ,}. 

Since there are uncountably many values of x in A, at which ly, ()} is 
not convergent nor eventually monotone then there is some fixed positive inte- 
ger d such that d, <d holds for uncountably many values of x in ao Call 
this set A so jn A is an infinite set of distinct elements. Let rr, 

= and r=2 with C,, = lia ve *y a, , for 

3, Z, by Theoren’ 2.1 there i an infinite subclass A 
of oT, such that for x, y eA, x-y € (9° u (-2°)) for m fixed. Also for 
x €A and k#j sufficiently large, depending on i, there exists a t € F..; 
such that y,(t)- ¢U,(@). 

Choose N > N(d@) and u(1) eA and F ayia) such that 
(S VA is infinite. Choose u(2) € (S F, S°) and 

U F 0212) NA is infinite. Continuing in this manner we get {u(1), u(2), 
+++, u(2N + 1)} in S® and 
which are mutually disjoint. Now by renaming if necessary we may assume 
that u(j+ 1)- u(j) €Q° for j= 1, 2,..., 2N. Let 


= min {lu %) DI, - (i+ 
1<i<2N 
so p>0. Choose ELF 


radius of G.4(;)i) iS less than p/2. Now {G 
41)! are mutually disjoint and if x € G 


} such that and the 


1 
then y~x €Q. Choose k # j, k, j > H(d), sufficiently large that for each 


odd positive integer a, 1 < a< 2N+1, y,(«)- yj) for some x, 
€ and for each positive even integer a, 2 < a < 2N, y,(t - y ,{t 
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<@ holds for some € G¢a)i(a) and TQ) - yr.) > @ holds for some 7 

Now consider the partition Po = (By where 
x, if a is odd; is omitted from if a is even and either % (a1) - 
and y, ¥;(a41)) > oF the opposite inequalities 
hold; is taken to be ¢, if and 
9 and B, is taken to be 7, if and 
< Then the partition Py is such that (y,-y,» Py) 
is a proper pair and y,(x,)- yx.) ¢ U,, (2) for a odd, x, € Po, and there 
are N+1 such points x, which is contrary to the hypothesis of the theorem. 
Hence it cannot be the case that B, is uncountable. 

Let By = iy, ays (y,, ay } and Py i= 1, 2,... be the count- 
able number of regular K — 1 dimensional hyperplanes through the points of 
Suppose yET with y#p, i=1,2,+++ and a, ¢y for 

i=1,2,+++ then Ins, (yn MA,=@ since otherwise would not 
be maximal. Then A, C pad p; so apply the induction hypothesis to the 
sequence ly, on consecutively, take the diagonal subsequence 
and denote it again by ly, 3 This sequence has the property that it is either 
convergent or eventually monotone at every point in S. 


5. Corollaries and other results. By restricting the range of the sequence 
of functions so that eventually monotone sequences in E. converge in E. 
the conclusion of Theorem 4.4 can be changed to read pointwise convergent. 
The following is an example of such a theorem. 


Theorem 5.1, Let B be a reflexive ordered Banach space with normal 
positive cone K and S be a nonempty subset of If ly, 3 is a sequence 
of functions that satisfies the hypothesis of Theorem 4.4 and ty ,(s)} is a 
norm bounded set for each s €S then there is a subsequence of ly, 3 which 
converges for every s €S. 


Proof. This follows directly from Theorem 4.4, 


Theorem 5.2 (Helly selection theorem). Let ly,} be a sequence of func- 
tions, y,:1+R, 1= [a, BIC R!. Suppose there is a positive constant K with 
ly, (x)} such that |y,(x)| < K for k=1,2,+++ and x and V,(y,;I)<K 
for k= 1, 2,+++~ Then there is a subsequence {h,} of that converges 
pointwise on I. 


Proof. Since V,(y,- N<V,O,; D+ I) < 2K the hypotheses 
of Theorem 5.1 are satisfied and the conclusion holds. 

Since { € BV, and f € BV, implies f € BV, the above Helly selection 
theorem holds if V,(y,; 1) < K is changed to V,(y,; I)< K or 
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In the case where the sequence of functions ly, is such that y,:5 > 


R, S CR!, we obtain a characterization of those sequences of functions which 


have pointwise convergent subsequences. 

Definition 5.3. Let S be a nonempty subset of R! and ly, be a se- 
quence of functions, y,: S + R. We say that the set ly, 3 is equioscillatory 
if for each s €S there exists a nested neighborhood basis of 0 of radii 
ein, s) and for each positive integer m there exist positive integers H(n) 
and N(m) such that if k, j > H(n) and (y,-y;, P) is a proper pair then P 
contains no more than N(n) points x for which |y,(x)— y,(x)| > en, x). 


Theorem 5.4. Let S be a nonempty subset of R! and ly, 3 be a sequence 
of functions, y,: S +R%. The sequence \y,} has a subsequence which is 
pointwise convergent if and only if it has a subsequence th,} which is point- 
wise bounded and is equioscillatory for i=1, 4: 


Proof. Apply Theorem 5.1 to {y,} coordinatewise to get a convergent 
subsequence. On the other hand if ly, 3 has a subsequence th} which con- 
verges pointwise to y, then it must be pointwise bounded. By letting «(, t) 
= SUP, jon (2) N(x)=0 and H(N) =n, then for k, j > H(n) we 
have ||h,(¢)- h (e)}| < en, t) for all t so that fh} is an equioscillatory se- 
quence for i= 1, 

The following two notes relate sequences equioscillatory and sequences 
being Cauchy. 

Note 1. The sequence ly, R!, is equioscillatory with 
N(n) = 0 if and only if ly, 3 is pointwise Cauchy. 

Proof. If ty, 3 is equioscillatory with N(”)= 0 then for 5(x) > 0 there 
exists a positive integer such that |y,(x)- yj) < dn, x) < (x) for all 
k, 7 > H(n). If is pointwise Cauchy choose x)= SUP, jon 
N(x)=0 and H(n) =n so that fy,} is equioscillatory. 

Note 2. The sequence ly,}, y,: 5 +R, SCR, is equioscillatory with 
N(n) = 0 and en, x)= €, anested neighborhood basis of zero if and only if 
ly, 3 is uniformly Cauchy. 

Proof. If ly, 3 is equioscillatory with N(n)= 0 and the nested neighbor- 
hood basis of 0 is en, x)= €, then for 5> 0 there exists a positive integer 
such that < 5 and ly, y Ax)| cn, x) for all k, > H(n). Con- 
versely if ly, 3 is uniformly Cauchy then for the nested neighborhood basis 
of radii en, x)= 1/n there exists an H(n) such that for k, j > H(n), ly, («) - 
y <1/n = en, x) so ly, 3 is equioscillatory with N(n) = 0. 
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ABSTRACT. Using the Iwasawa decomposition 9= t*@a@n of a real 
semisimple Lie algebra g, Harish-Chandra has defined a now-classical 
homomorphism from the centralizer of € in the universal enveloping alge- 
bra of g into the enveloping algebra @ of a. He proved, using analysis, 
that its image is the space of Weyl group invariants in @. Here the weaker 
fact that the image is contained in this space of invariants is proved ‘‘pure- 
ly algebraically’’. In fact, this proof is carried out in the general setting of 
semisimple symmetric Lie algebras over arbitrary fields of characteristic 
zero, so that Harish-Chandra’s result is generalized. Related results are also 
obtained. 


1. Introduction. Several years ago, Harish-Chandra introduced a certain 
mapping which now lies at the foundation of many extensive approaches to 
the representation theory of semisimple Lie groups. Let g= € ®a@n be an 


Iwasawa decomposition of a real semisimple Lie algebra, § the universal 
enveloping algebra of g, e the centralizer of € in §, and @ the universal 
enveloping algebra of a. The Harish-Chandra mapping to which we refer is 
the homomorphism p: g‘ — @ defined by the projection to @ with respect to 
the decomposition § = @ ®(€G + Gn) (see [2(b), $4]). Probably the most 
significant single property of p is that its image is contained in the algebra 
G. of suitably translated (by half the sum of the positive restricted roots) 
Weyl group invariants in @. (Its image actually equals Gy.) See [2(b), $4] 
for the original proof. Although this property is ‘‘purely algebraic,’’ we know 
of no existing proofs which do not rely on analysis on the corresponding real 
semisimple Lie group. The main purpose of this paper is to present a “‘purely 
algebraic’’ proof of the fact that p(S*) C Gy. The problem of finding such a 
proof was posed by B. Kostant and also by J. Dixmier. 
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In his recent book [1], Dixmier sets up an algebraic formalism which re- 
covers the ‘‘algebraic’’ properties of real semisimple Lie algebras. Beginning 
with a ‘‘semisimple symmetric Lie algebra’’—a pair (g, 6) where g is a semi- 
simple Lie algebra over an arbitrary field of characteristic zero and @ is 
an arbitrary automorphism of g such that 9? = 1—he obtains Cartan sub- 
spaces and Iwasawa decompositions [1, $1.13]. He then shows that certain 
theorems on representations of real semisimple Lie algebras, including some 
results of [2(a)], [5] ard [6], carry over to the general context [1, Chapter 9]. 
Our proof of the theorem pS") C a, holds in this setting, and therefore gen- 
eralizes Harish-Chandra’s original result. Our argument, which is very differ- 
ent from the existing analytic proofs, is not long; much of this paper consists 
of material on semisimple symmetric Lie algebras which is well known in the 
familiar special case of real semisimple Lie algebras. 

The contents of this paper are as follows: In $2, we give an exposition 
of the relevant properties of semisimple symmetric Lie algebras, including a 
discussion of the restricted root system and the restricted Weyl group. 

The subject of $3 is the restriction homomorphism from the algebra of 
€-invariant polynomial functions on } into the algebra of polynomial functions 
on a, where g = € @b is the ‘‘symmetric decomposition’”’ (i.e., eigenspace 
decomposition) of Q corresponding to 0, and @ is a “‘splitting’’ Cartan sub- 
space of ). We show that this map injects into the algebra of Weyl group in- 
variant polynomial functions on a. We do not know how to prove algebraically 
that it maps onto these invariants, except when dim a = 1. This would be an 
algebraic generalization of Chevalley’s polynomial restriction theorem, and 
could be used to prove th-t pS") is all of <.. Our proof of the fact that the 
restriction homomorphism maps into the Weyl group invariant polynomials re- 
duces the problem to the three-dimensional simple case and solves it there. 
The injectivity follows from [1, Proposition 1.13.13], but our proof avoids the 
use of algebraic groups. We include an alternate proof, due to G. McCollum, 
of the key lemma for the injectivity. 

The main theorem is stated and proved in $4. We include mention of the 
kernel of p, which is already known in the general setting (see [5, Remark 
4.6], and the presentation in [1, Proposition 9.2.15]}), although because of our 
injectivity result in $3 we can again avoid using Lie or algebraic groups. The 


proof that oS‘) C ay, is done in two stages: First we prove it when dim a 
= 1 (and in this case we also prove that (8°) - a), using $3, Then we re- 


duce the general case to this case by examining suitable semisimple subal- 
gebras of g associated with the simple restricted roots. The intermediate re- 


sult, Theorem 4.17, is also interesting. 
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Finally, in the Appendix, we give a vector-valued generalization of the 
injectivity result of $3. This result also generalizes an argument in [5, proof 
of Lemma 4.1] (see also [6] and [1, Lemma 9.2.7, part (b) of the proof]) which 
depends on Lie or algebraic groups. Our original proof was simplified by G. 
McCollum. 

We would like to thank McCollum for many valuable conversations and J. 
Dixmier for generously giving us access to the manuscript of his book. Cer- 
tain of our methods were inspired by arguments found in [4] and [7, P. Cartier’s 
Exposé no. 18]. 

Notations. The dual of a vector space V is denoted V*. Z,,Q and R 
denote respectively the set of nonnegative integers and the fields of rational 
and real numbers. The restriction of a function / to a subset X of its domain 
is written /|X. 


2. Preliminaries on semisimple symmetric Lie algebras. Fix a field k of 
characteristic zero. Let (g, 6) be a semisimple symmetric Lie algebra over 
k, in the sense of [1, $1.13]. That is, g is a semisimple Lie algebra over k 
and @ is an automorphism of g such that 6? = 1. Let £ be the subalgebra 
of fixed points for 9, and let ) = {x € g|@x =-x}, so that g= € + b is a di- 
rect sum decomposition, orthogonal with respect to the Killing form of 9. 
This is called the symmetric decomposition of 9 defined by 0. We have 
[€, b] and [p, plc €. 

Let a be a Cartan subspace of }, that is, a maximal abelian subspace 
of ) which is reductive in g; Cartan subspaces exist by [1, Théoréme 1.13.6]. 
Let m be the centralizer of a in €, l an arbitrary Cartan subalgebra of m 
and § = [@a. Then § is a Cartan subalgebra of g [1, Proposition 1.13.7]. 

Let k be a field extension of k, 9 = 9 @k, € = E@k, etc., and let 0 
be the k-linear extension of 6 to 9. Then (9, @) is a semisimple symmetric 
Lie algebra over k with symmetric decomposition § = € ® $, @ is a Cartan 
subspace of , Mi is the centralizer of Z in €, T (resp., §) is a Cartan sub- 
algebra of (resp., 9), and § = T 

Suppose that § is a splitting Cartan subalgebra of 9. (This can be in- 


sured by choosing k to be algebraically closed.) Denote by RC 5* the set 


of roots of § with respect to §. 

Assume now that @ is a splitting Cartan subspace of } in the sense of 
[1, $1.13], ie., for all a@€ a, the operator ad a on g can be upper triangu- 
larized and hence diagonalized. Consider the root space decomposition of 9 
with respect to 6: 


3=5e]] 


AER 
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where §* denotes the root space for A. Let P: 5*— @* denote the restric- 
tion map, and let = denote the set of nonzero members of P(R). For all 
k-linear functionals 6: T— k, let 


3? = {x € x] = dla)x for all ae 
Then clearly 


and LI 9°. 
Now for all k-linear functionals ¢: a—k, define 


9? = {x € glla, x] = for all ae ah. 
Then 


=m @a, 
and since @ is a splitting Cartan subspace, & is identified with (i.e., is the 
set of k-linear extensions of the members of) {¢ € a*l¢ # 0 and 3? # O}, and 
g-9°@ II I] 
pez det 
The members of ©, regarded as elements of either @* or @*, are called the 
restricted roots of g with respect to a. = spans a” over k and @* over k. 
Note that [g%, g¥]¢ and that 09% = for all we 
For all = 119%, where A ranges through {A € R|P(A) = and 
setting R’ = {A € R|P(A) = 0}, we have 
5°. 
Moreover, R‘|l is the set of roots of the reductive Lie algebra Ti with re- 
spect to its splitting Cartan subalgebra T; for all A€ R’, the root space 


3°; and 


m-T® 9° 
AeR’ 
(see [1, Propositions 1.13.7(iii) and 1.13.9]). Also, setting R” = {A € R|P(A) 4 O}, 
we have P(R") = = by definition. 
Let B be the Killing form of g and B its k-bilinear extension to 9, so 
that B is the Killing form of §. Then B is nonsingular on 5, and so defines 


naturally a nonsingular symmetric bilinear form, denoted B’, on 5*. More- 


over, since B(l, &) = 0, B is nonsingular on @, thus defining a nonsingular 


symmetric bilinear form on a™. Let us identify &* with the subspace 

{Ae h*|A|T = 0} of §* by extending the definition of each element of &* by 
requiring it to be zero on T. Then the natural bilinear form on @* is exactly 
the restriction of B* to @*. Moreover, if we also identify * with the sub- 
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space of elements of 5* vanishing on then a*, and B*(L*, a*) 
= 0. In particular, the restriction map P: 5* — &* coincides both with the 
projection to @* with respect to the above decomposition and with the orthog- 
onal projection to with respect to B*. 

The automorphism 0 of 3 is lon Tand -1 on @, and so preserves 5. 
The transpose of 6\5, a we denote by 0" , is the isometry of 5* which 
is 1 on a and ~1 on @*. Thus P: 6*— @”* can be realized by the formula 
- 

59 denote the rational span of R in §*. Then §*= k 
in a natural way. Moreover, B* is Q-valued and positive definite on the ra- 
space Now preserves R and hence preserves and so 

= ¥%(1 - also Thus since © consists of the nonzero 
of P(R), C 56 » SO for all € B*(¢, is a positive ra- 
tional number. But B is SE on @ because B is nonsingular on %. 
Hence B induces naturally a nonsingular symmetric k-bilinear form (-, -) on 
a‘. If we identify &* with a* ®, k, then B*|a* is just (-,-) since B*|&@ is 
the canonical form on @* defined by B|@. Hence B*(¢, ¢) = (¢, ¢) for all 
¢ € =, and we have the following two lemmas: 


* 
a, 


Lemma 2. 1, Let 50 and = Then 
=§5 ks k and (*= k. Moreover, is the 


Lemma 2.2. B*|5*, is rational-valued and positive definite. B is non- 
singular on a. Denoting by (+,+) the corresponding canonical nonsingular 
symmetric k-bilinear form on a*, we have that B*\|a*=(-,+). In particular, 
(.,+) is rational-valued and positive definite on and for all € X,(¢, 
is a positive rational number. 


For each AER, let Ww? 5*— §* denote the orthogonal reflection 
through the hyperplane of 5* orthogonal to A (with respect to B*). Then w, 
is an isometry of 5* which preserves 56 and R. The Weyl group Wp of 
3 with respect to § is defined to be rm. group of isometries of §* or of 56 
generated by the w, (A€ R). 

Now let E be the real vector space 56 BB R. Then the restriction of 
B* to 56 extends naturally to an R-bilinear form B,, on E. Since B* is 
positive definite on 60 Bz is positive definite on E and hence is a Euclid- 
ean scalar product on E. W, extends naturally to a group of isometries, also 
denoted W,, of E, and R becomes a reduced system of roots in E with Weyl 
group W,, in the sense of [1, _Appendice ] and [8, $1.1.2]. 

Recall that the isometry 0* of 5* preserves R and Lp The R-linear 
extension of 0* 169 to E is an isometry of E with square r which we call 
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6,. Let o=~0,, so that o is an isometry of E which preserves R and has 
square 1. Then (R, 0) is a o-system of roots in E, in the sense of (8, $1.1.3], 
except that we allow the éases o= +1. 

Let E, (resp., E_) denote the +1 (resp., -1) eigenspace of o in E, so 
that E=E,@E_, and this is an orthogonal deceomposition. Then 


—* 


and E, is the real span of £. Recall that we have defined R’ ={A€R|P(R)=0} 
and R” = R|P(R) # 0}. Thenclearly R'=ROE_, 


R' = Rlod = -A} = fre RIA = 0} 
and 
={AeER|oA =frAERIAlT O}. 
Recall that if A€ R’, then the root space 9’ C Ti. 


Lemma 2.3. For all XE R, oA-A¢ R. 


Proof. Assume that oA -AER. Then oA-AER’, and so A-oAE R’, 
Thus WM. Let e, be a nonzero vector in 3°. Then 
and so [e,, 0e,] is a nonzero element of C ™. But Ole,, = 
e,]=-Te,, Ge,], so that [e,, 6e,] € This contradiction proves the 
lemma. Q.E.D. 

This result asserts that (R, a) is a normal o-system, in the sense of 
[8, $1.1.3]. (The proof here, which also appears in (3, p. 76, proof of Lemma 
3.6], is more direct than the proof given in [8, Lemma 1.1.3.6] for the special 
case of real semisimple Lie algebras.) The results of [8, $1.1.3] on normal 
o-systems are now applicable in our context. (The cases +1 do not cause 
any difficulty.) In particular, since = is the set of orthogonal projections to 
E, of the members of R", we have by [8, Proposition 1.1.3.1]: 


Lemma 2.4 (S, Araki). = is a (not necessarily reduced) system of roots 
in E,, in the sense of (8, $1.1.2]. The Weyl group W of = is the group of 
isometries of E, (with respect to B,) generated by \s4|\P€ >} where sy is 
the reflection through the hyperplane of E, orthogonaltto ¢. 


W preserves E, 1 5O- =", and its restriction to this space extends 
naturally to a group yn isometries, still denoted W, of a, with respect to the 
bilinear form (-,-) in Lemma 2.2. In this context, W is called the restricted 
Weyl group of g with respect to @. It is the group of isometries of a” (with 
respect to (.,-)) generated by {s4|h€ =}, where in this case sy is identi- 
fied with the orthogonal reflection through the hyperplane of a orthogonal to 


= 
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¢. Similarly, W extends to a group of isometries of @*. 
We shall need the following result: 


Lemma 2.5. Let and s€W. Then dim 9® = dim 


Proof. It is sufficient to show that the k-dimensions of 3° and 3°? 
are equal. By [8, Lemma 1.1.3.5 or Proposition 1.1.3.3], there exists w € Wr 
(the Weyl _ group for respect to 5) such that w, as an iso- 
metry of 5* end @* and (*, and restricts to s on &*. Hence P ow = 
wos: But w preserves R, and hence takes R = {AE R|PA) = 
onto R.4 = {A€ R|P(A) = sd}. Since 


AeR AER 
and each 3° is one-dimensional, the lemma is Bane Q.E.D. 
Let 2, be an arbitrary positive system in the root system &. Then we 
have the decomposition 


(+) g-n@c® II 9%. 


ez, per, 
Let n be the subalgebra Ig? (Pe=,) of g. 
Lemma 2.6. We have g= € ®a@n. 


Proof. To show that g= €+ a+ n, it is sufficient, in view of (*), to 
show that g-? C forall But if xe Ox € O97? = g?, so 
that x = (x + Ox) £4 n. Now suppose €, a and and sup- 
pose x+y+z=0. Then 0=Ax+y+z)=x-y+Oz, sothat 2y+z-Oz= 


0. But Oze Ugex, g~?, and so by the directness of the sum (*), y = z = 0. 
Hence x =0 also. Q.E.D. 


This decomposition is called the Iwasawa decomposition of 9 associated 


with 0, a and 2,. We may choose a positive system R, for R such that 
{A€ where = R"N R,, and the Iwasawa decomposi- 
tion implies that f = £ ®2@ User” 3°. We shall not need this last fact. 


3. The polynomial restriction map F,. Let k be a field of characteristic 
zero. For every finite-dimensional vector space V over k, let S(V) denote 
the symmetric algebra over V. Since k is infinite, S$(V*) is naturally isomor- 
phic to the algebra of polynomial functions on V, i.e., the algebra of sums 
of products of linear functionals on V. (The isomorphism takes the symmetric 
algebra product /,/,+++ f, of linear functionals /; to the corresponding prod- 
uct {,/, +++ f, of functions on V.) Hence we may, and often shall, identify 
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S(V*) with the algebra of polynomial functions on V. 

Let g= © ®h be the symmetric decomposition of a semisimple symmet- 
ric Lie algebra (g, 9) over k , 2C } a splitting Cartan subspace, and W 
the corresponding restricted Weyl group. Then € acts on ), hence on b* by 
contragredience, and thus on S( b*) by unique extension by derivations. De- 
note by S( p*)' the corresponding algebra of €-annihilated vectors. Also, W 
acts on a‘, and hence acts on S( <a’) by automorphisms. Let S( at)” be the 
algebra of W-invariants. 

Denote by F : S(*) — S(a*) the restriction homomorphism, and let 
F, = so that Fy: S(p*)* S(o*). 


Theorem 3.1. We have F,(S(p*)*) and F,: s(t)” 
is an algebra injection. , 


Proof. By passing to an algebraic closure of k if necessary, we observe 
that to prove the theorem it is sufficient to prove it incase k is algebraically 
closed. We now make this assumption. However, we shall need it only in the 
proof that F,(S( b*)*) c s(a*)”, and only after Lemma 3.3. 

First we shall show that F,(S(p*)*) C S(a*)™ and then that F, is injec- 
tive. The first assertion will be proved essentially by reducing to the case 
in which g is three-dimensional simple. 

Let B be the Killing form of g. Define a bilinear form Bg on g by 


y) = Oy) 


for all x, y€ 9, so that Bg is a nonsingular symmetric form. 
* 
Let = C a be the set of restricted roots of 9 with respect to a, and 
let m be the centralizer of a in €. 


Lemma 3.2. The decomposition g= ® COll sey g? is a B g-orthogonal 
decomposition. In particular, Bg is nonsingular on each 9? (Pex), on m 
and on Also, B is nonsingular on m and on 4. 


Proof. It is easy to see that for all ¢, Wed, Bl g?, g”) = 0 unless + 
= 0, and that BC g?, m+ a)=0. Since Og? = for all and since 
Bm, a) = B(m, a) =0, the decomposition g= m@ a@ll is Bg-or- 
thogonal. Since Bg is nonsingular, the restriction of Bg to each component 
in this sum is nonsingular. Q.E.D. 

(The nonsingularity of B on @ was proved another way in $2; see Lem- 
ma 2.2.) 

Since B is nonsingular on a, B induces a nonsingular symmetric bilin- 
ear form (-,-) on a” and an isometry from a* onto a. For all Pex, let 
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x4 € a be the image of ¢ under this isometry. Then B(x4, a) = f(a) for all 
aé a, and B(x4, xy) = = (¢, for all Wed. 


Lemma 3.3. Let 3. For all e€ g?, 
[e, de] = Ble, Ge)x 4 =-B e)x 


Proof. Since Oe € 6g? = [e, de] em+ a. But Ole, Ge] =-[e, Gel, 
so that [e, Oe] € p. Hence [e, Oe] € a. Since B is nonsingular on @, it is 


sufficient to show that B(a, [e, 0e]) = Bla, Ble, Ge)x 4) for all a€ a. But 


B(a, [e, = B(La, el, = B(pla)e, Oe) = G(a)Ble, Oe) = Bla, x 4) Ble, Ge) 
= Bla, Ble, Ge)x 4), 


proving the lemma. Q.E.D. 
Let GES. Since (d, d) 4 0 (see Lemma 2.2), we can define 
by = a, 
and we have phy ) = 2, 
Also, since Bg is a symmetric nonsingular form on g? (Lemma 3.2), 


there exists e € such that Be, e) 0. Setting 


(2/(¢, $)B ge, e))! /2e, 
which we may do since k is algebraically closed, we get 


Bele eg) = 
Thus from Lemma 3.3, we have: 

Lemma 3.4, [hy, eg]=2e4, [hg,—Oegl= and In 
particular, Gey} spans a three-dimensional simple subalgebra 94 
of 4. 

It is clear that 94 is stable under 0, so that Gy = ty ® Ry» where 
94M and = 94 Np. Moreover, (gy, is a semisimple sym- 


metric Lie algebra. We have 
= Key + Ge 4) and =khy® Keg Ge 4). 
We shall use gy to show that the restriction to @ of every element of S( p*) 


is invariant under the Wey] reflection with respect to $. 


From Lemma 3.4, we have 


+ Gey), hy) = Ge 4), Ale, + bey), es Gey] = hy 
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and + Bes), t]=0, where t= Ker dC a, 

For all fe S(p*), + = + Oey) > (71 Ry t). 
In particular, if € S(p*)*, then = hy ® t) is a €4-annihilated polyno- 
mial function on fy ® t, where ty = Key ® Ge) acts on Ry @ t as indi- 
cated above. The determination of /' is a simple, standard problem in ‘‘clas- 
sical invariant theory,’’ which we proceed to solve. 

Let x=hy + (-1)'/%(e, y= hy - and let 
iz, z,} be a basis of t. Then the basis x, y, Z,, +++, z,, of Py @t= 
fy + @ diagonalizes the action of 14(-1) + Oe 4), with eigenvalues -1, 
1, 0, , 0, respectively. 

Let X, Y,Z,,+++,Z,, be the basis of (py t)* dual to x, y, 2), 
z,» so that /’ is a polynomial in these variables. Moreover, + Oe 4) 
acts on such a polynomial by the derivation law and the negative transpose of 
the action on ®t. Hence X, 
of (p, ® t)* with eigenvalues 1,-1, 0,..., 0, respectively. 

Write 


is a basis of eigenvectors 


REZ, 
where the /.,’s are uniquely determined polynomials in the Z,;’s. The invari- 
ance of /‘ under 4(-1)/%e, + Ge 4) asserts that 
> Gj - (Z,, eee »Z,)=0, 
ise., that /;, = 0 for all pairs j,k such that j# k Hence is 4(-1)/%ey + 6e4)- 
invariant if and only if f is of the form 
4 
which the /;’s are polynomials in the Z,’s. 
Now let H=X+Y and E=(-1)'/%(X — Y), so that the basis H, E, Z,, 
Z, of (hy t)* is dual to the basis hg; ey - Be 4, Zi, 2, Of 
hy ® t. Then /' is of the form 


+ (Z 1, Z,)s 
where the g;'s are polynomials in the Z,’s. 
Since H|@ is a nonzero multiple of ¢, E|@ = 0 and each Z ja annihi- 
lates hy, we have - 


7€Zy 
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where each /; is a polynomial in linear functionals on @ which are orthogo- 
nal to ¢ with respect to (+,+). We have shown that for all fe S(p*)*, f|a = 
{'|a is an element of S(a‘) left fixed by the Weyl reflection with respect to 

¢. Since these reflections generate W as ¢ ranges through &, /|aeS(a’)™, 
This proves the first part of the theorem. 

We turn now to the injectivity of F,. In the following proof, we need not 
assume that k is algebraically closed. We begin with some general comments 
on symmetric algebras. 

Let V be a finite-dimensional vector space (over k), and for all r € Z,, 
let SV) denote the rth homogeneous component of S(V). There is a natural 
pairing {-,-} between S’(V*) and S’(V) given as follows: 


r 


where vj, v,€V, sf € +) is the natural pairing between 
v* and V and o ranges through the group of permutations of {1, ..., r}. 
Then for all v€V and f € S(V*), ff, v7} = rlf(v) (regarding { as a polynomial 
function on V on the right-hand side). We have two immediate consequences: 


Lemma 3.5. (i) {-,-} is a nonsingular pairing. 
(ii) Let Z be a Zariski dense subset of V (i.e., for all f € S(V*), {(Z) 
= 0 implies {= 0). Then {z’|z€Z} spans S’(V). 


Now € acts naturally as derivations on S(p) and S(p*). 


Lemma 3.6. For each re Z,, the natural actions of € on S"p*) and 
S"(p) are contragredient under {-,-}. 


Proof. Let x€ €, y€ ) and ze h*, By Lemma 3.5(ii), it is sufficient to 
show that {x - 2’, y’}=-{z’, x -y"}. But 


= =rr!(z, [x, y])(z, = riz’, Lx, =-{z’,x-y"}, 


and this proves the lemma. Q.E.D. 

The next lemma is the crucial one. We give two proofs, the first inspired 
by P. Cartier’s argument in [7, p. 18—20, Proposition 1], and the second due 
to G. McCollum. 


Lemma 3.7. Under the natural action of € on S$"), Sa) generates 
In particular, 


= + Sp). 
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Proof #1. It is clearly sufficient to prove the first statement. Since 9 = 
n@c@lly ey g?, p= a©@4q, where q is the span of fe—@elee g?, pe 


Now 


= [] SX Ha). 


It will be sufficient to prove by induction on j that the smallest €-invariant 
subspace T of S$’) containing $’(a) also contains S4(q)S’~(a). This is 
clearly true for 7 = 0, so suppose it is true for 0, 1,..., 7. We shall now 
prove it for j + 1. We assume that j <r. 

Let e€ g?, s€S(q and a€ a. Then e + Oee and 


(e + Oe) sa’~) = ((e + Oe) - (r f)hla)s(e ~ 


The left-hand side and the first term on the right are in T by the induction 
hypothesis, and so ¢(a)s(e ET. Let Z = {ae ald(a) 0 for all 
€ =X}. Then Z is Zariski dense in @ since it is the subset of @ on which 
finitely many nonzero polynomial functions do not vanish; the fact that S( a‘) 
is an integral domain implies easily that any such set is Zariski dense. Then 
for all e€ g?, s€Sq) and a € Z, sle Oe)a’~%*") ET, But by 
Lemma 3.5(ii), {a7~%*|a eZ} spans Also, as and s vary, 
the terms s(e —@e) span S/*(q). Thus we have shown that 


T, 


completing the induction. Q.E.D. 

Proof #2 (McCollum). Use the first paragraph of Proof #1 and continue as 
follows: 

Let 6€ and choose w€ such that = 1. Let t= Ker ¢, so that 
a= kw ®t. Now let e g?, s €S(q) and where 1<i<r-—j. 
Then e+ €, and 


(e + Ge) swit = ((e + Oe) isle + swi((e + Oe) 2). 


The left-hand side and the first term on the right are in T by the induction 

hypothesis, and the last term is zero because t € S(t). Hence s(e- 6e)w*~"4 

€T. But as i and ¢ vary, the products wily span s7-G+0(q), so that 

s(e C T. Also, as e and s vary, the products s(e—- e) 
span Si*1(q), Hence S/*(q)s7~i+%a) C T, and this completes the induc- 

tion. Q.E.D. 


To complete the proof of the injectivity of F,, let f € S( p*)! 


and assume 
{|a=0. The homogeneous components of / are annihilated by € since the 


decomposition 


j 
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= Il 
j=0 


is a €-module decomposition. Also, the components of { vanish on @ be- 
cause @ is closed under scalar multiplication. Hence we may assume f[ € 
Sp*) for some r € Z,. Consider the pairing {-,-} between Sp") and 
Now a7} =0 for all a, so that {/, S%a)}=0 by Lemma 3.3(ii). 
Also, for all x € € and s€ Sh), tf, x+ s}=-{x+ f, s}=0, using Lemma 3.6, 
Thus {/, S(p)}=0 by Lemma 3.7, and /=0 in view of the nonsingularity of 
{-, +} (Lemma 3.5(i)). This proves the injectivity of F,, and hence the 
theorem. Q.E.D. 

Remark. In the Appendix, we shall give a vector-valued generalization 
of the injectivity of F,. 

In case dim @=1, we get more information. We now assume that dim @ 
= 1, The following result is clear: 


Lemma 3.8. S(a°)” consists of the even polynomial functions on 4, i.e., 
those polynomial functions { on a such that {(a) = f{(-a) forall aé a. If f 
is an arbitrary nonzero homogeneous quadratic polynomial function on 4, then 
{ generates S(a°)", and S(a*)” = Kf] is the polynomial algebra generated 
by f. 


The Killing form B of 9 is nonsingular on a (Lemma 2.2 or Lemma 3.2), 
and its restriction to ) is €-invariant. Thus the function b on } defined by 
p ++ B(p, p) is a homogeneous quadratic €-invariant polynomial function on ) 
whose reStriction to @ is nonzero. Hence the last lemma implies: 


Lemma 3.9. The subalgebra Kb] of S(p*)* generated by b is the poly- 
nomial algebra generated by b, and F,: kb] —'S(a*)” is an algebra isomor- 
phism. 


In view of Theorem 3.1, we therefore have: 


Theorem 3.10. Suppose dim a= 1, Then F,: S(p*)* — s(a*)” is an 
algebra isomorphism, and S(p*)' = Kb); here kb) is the polynomial algebra 
generated by b. 


Since the restriction of B to ) is nonsingular and €-invariant, B in- 
* 
duces a €-module isomorphism from the contragredient f-module }" to }, 


and hence a €-module and algebra isomorphism from S(p*) to S(p). Let by 


€ S(p) be the image of 6 under this isomorphism, so that by is the canonical 
quadratic element of S(p) associated with the restriction of B to $, and by 
is annihilated by €. Let S(p)* denote the subalgebra of Gannihilated vectors 
of S(p). From Theorem 3.10, we have: 
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Corollary 3.11. Suppose dim a=1. Then S(p)* is generated by by, so 
that S(p)* = Kb], and kKLbo] is the polynomial algebra generated by by. 


4. The Harish-Chandra map p,. Let g= € ®) be the symmetric decom- 
position of a semisimple symmetric Lie algebra (g, 0) over a field k of char- 
acteristic zero, and let @ be a splitting Cartan subspace of ). Denote by 
= Ca" the corresponding restricted root system and W the restricted Weyl 
group. Fix a positive system £,C &, and let g= € ®a@n be the corre- 
sponding Iwasawa decomposition. Define p€ a by the condition 


pla) = % tr(ad 


for all a€ a, or equivalently, 


p=5 (dim 9?)¢. 
per, 

Let G be the universal enveloping algebra of g, and let K, @ and Ni be 
the universal enveloping algebras of €, a and n, respectively, regarded as 
canonically embedded in §, by the Poincaré-Birkhoff-Witt theorem. The mul- 
tiplication map in § induces a linear isomorphism § ~ K @@@N, by the 
same theorem. (In this section, ® denotes tensor product over k.) Identify- 


ing G with KOAON, we have 
-KOROGn 
=(k- 1@€K) @@ 


Let p: GC — @ be the projection with respect to this decomposition. Since 


we have 


and p is also the projection to @ with respect to this decomposition. 

Since a is abelian, @ may be identified with the symmetric algebra S(a), 
and hence with the algebra of polynomial functions on ar, Every affine auto- 
morphism T of a” gives rise to an algebra automorphism T of @= S(a), de- 
fined by (T/A) = {(T7A) for all f € @, A€ a*. When T is translation by 
p, i.e., the map which takes A€ a” to +p, we denote T° by r. Then 
(r{(A) = f(A p) for all / € @ and A€ a’, and may be characterized as 
the unique automorphism of @ which takes a€ a to a—p(a). 

Now W is a group of linear automorphisms of a*., For all sé W, s* is 
the unique automorphism of @ which acts on @ according to the contragredi- 
ent of the action of s on a. Moreover, W acts as a group of automorphisms 


-@ @( EC + Sn, 
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of @ in this way. Let @” be the algebra of W-invariants in @. 
Let §* denote the centralizer of € in G, and let p, be the map (rop)|G* 
so that p,: — @. 


Theorem 4.1. The map p,: gt — @ is an algebra homomorphism with 
kernel gt n tG= AGE and image contained in 


Proof. The fact that p, is a homomorphism is easy: Let x, y € GF and 
write 


x =a(mod(€G + §n)), y =b (mod(€S +§n), 


where a, b€@; then a= p(x) and b= ply). We have 
xy = xb (mod(E§ +Sn)) (since ) 
= ab (mod(€S + Sr), 


since la, n] Cn. Hence 


xy = p(x)ply) (mod (ES + Sn)), 


and so p(xy) = p(x)ply). Since 7 is a homomorphism, p, is also a homomor- 
phism. 

Now Ker p, = Ker p\S*, and the fact that Ker oS! = et ntG= Cn Ct 
is proved in [1, Proposition 9.2.15]; the proof is essentially that of [5, Remark 
4.6]. (Actually, the cited result deals with the projection to @ with respect 
to the decomposition § = @ @(GE + nG), but we get the desired result either 
by applying the transpose antiautomorphism of © or by imitating the argument 
in [1] or [5] for the present map p.) The cited proof simplifies somewhat in 
the present special case. Also, in place of the argument in [5, Proof of Lem- 
ma 4.1] (see also [6] and [1, Lemma 9.2.7, part (b) of the proof]), which uses 
methods from the theory of Lie or algebraic groups, we can instead use the in- 
jectivity assertion in Theorem 3.1 above, whose proof of course does not in- 
volve Lie or algebraic groups. Incidentally, in the Appendix, we show how 
the injectivity argument in Theorem 3.1 can be used to give a proof of [1, Lem- 
ma 9.2.7(b)] in full generality, and even to generalize it, without algebraic 
groups. The cited proof of the equality g a) tG = ge" nN Gt is independent of 
the assertion about the kernel of p,. None of the above requires k to be al- 
gebraically closed. 

We must now show that p,(S') Cc @”. We shall do this first when dim a 
= 1, in which case we shall also show that the image of p, is exactly a 
We shall finally reduce the general case to this case. 

Assume now that dim a = 1. In proving that »,(S') = @”, we may, and 
do, also assume that k is algebraically closed. In fact, however, this as- 
sumption will only be used in proving Lemmas 4.2, 4.3 and 4.4. 


208 J. LEPOWSKY 


Let A: S(g) — § be the canonical linear isomorphism from the symmetric 
algebra of g to the universal enveloping algebra, so that A is defined by the 
formula 


1 
Me, = — 8a(1) *** 8o(n) 


for all ne Z, and 8; € 93 here the product on the left is taken in S(g), the 
products on the right are taken in G, and o ranges through the group of per- 
mutations of {1,..., 7} (see [i,$2.4]). For all ge g and n€ Z,, 
and this condition determines A since the powers of elements of g spar S(q) 
(see Lemma 3.5(ii)). Moreover, A is a 9-module isomorphism with respect to 
the natural actions of g on S(g) and § as derivations (see [1, $2.4.10]). 

Let B be the Killing form of g, so that B is nonsingular on . Let b, 
be the canonical quadratic element of S(p)’ associated with the restriction of 
B to }, as at the end of $3, and set Uy = €A(S(p)*) Our goal now 
is to compute 

As in $3, we define the nonsingular symmetric form Bg on g by Bx, y) 
= —B(x, Oy) for all x, y€ g. Then Bg is nonsingular on a@®n, and B,(a, n) 
= 0 (Lemma 3.2). 


Lemma 4.2. Define the linear map ®n— by the conditions {= 1 
on a and f=27-1/%1-@) on n. Then f(a@®n)C h, and a®@n—b is 
a linear isomorphism which is an isometry from Bg to B. 


Proof. Clearly, {(a@n) C ). From the Iwasawa decomposition, it fol- 
lows that (1 —6):a @n-— is a-linear isomorphism, and so {: a®@n — 
is also a linear isomorphism, since {= on and 2~!/%1- 6) onn. 

We must now show that for all x, ye a@n, B(/(x), /(y)) = Bg(x, y). This 
is true if x, y€ a since Byg=B on a. Let x€ a, y€n. Then Bg(x, y) =0. 
But 


(x), = 27% B(x, y Oy) = 2-% B(x, y) 27% B(x, Oy) = 0, 
so that the desired relation again holds. Finally, let x, yé€n. Then 


(x), f(y) = 4 B(x -Ox, y Oy) = -4Blx, Oy) — 4 B(Ox, y) = Balx, y). 


The lemma follows from the bilinearity and symmetry of Bg and B. Q.E.D. 
Let a€ =, be the (unique) simple restricted root, so that n= 9° @g?%, 
and g** may be zero. Since k is algebraically closed and Bg is nonsingular 
on a, and (Lemma 3.2), we may choose e, € @ such that ,,e,) 
= 1 and B,rorthonormal bases ..., e° of g* and of 
The orthogonality of the decomposition a ®g* ® g?* (Lemma 3.2) implies 
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that et is a Bgrorthonormal basis of a@n. 
Hence by Lemma 4. 2, f(e,), {(e*), j(e2*), eee {(e2%) is a 
B-orthonormal basis of ). This basis is 2-1/2 ~ 


Ge2*), But if 000; x, is any basis of }, 


by x? in S(p), and hence =N by) = x? in §. Thus 


To compute p,(u,), first note that p,(e7) =(r = r(e7) =(e,-ple,))*. 
Now let e = er (1 <i<n or (1 <j<s). Then 


— Oe)? = %4(2e —(e + Oe))? 


= 4 (4e? + (e + Oe)? —2e(e + Oe) —2(e + Oe)e) 
= -ele + Oe) (mod(ES + 


= (mod(€S + Cn) 


=-[e, de] (mod(€S + @n)). 
Recall from $3 that x, is the unique element of @ such that B(x,, x) = a(x) 
for all x€ a and that x,,= 2x, (if 2a€%). Since Bg(e, e) = 1, Lemma 3.3 


implies that [e, Oe] =-x, if e € g* and [e, Oe] = -2x, if e € g?*. Thus from 
the above computation, 


plug) = + (r + 2s)x, = e? + (dim g* + 2 dim g?*)x, 
and hence 
p, (uy) = (e, ple + (dim g* + 2 dim g?* (x, p(x,)). 


Let w be the unique element of @ such that a(w) = 1. Then by the de- 
finition of p, 


= '%4(dim 9* + 2 dim g?%), 


Let w=ce, and x,=de, (c, dé k). Then since B(x,, w) = a(w) = 1 and 
Ble,, e)= Bele, e,) = 1, we have that cd=1. Thus 


Py(utg) = (e, - ple + plx,)) 
= (e, - ple,))? + 2cdple Ne, - ple,)) 
= (e, - ple,))? + 2ple, Ke, ple,)) 
ple,)?. 
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Summarizing, we have proved: 


Lemma 4.3, Assuming that dim a =1 and that k is algebraically closed, 
choose e, € a such that Ble,, e,)=1. Then 


= ple,)? = (e, + ple, Me, - ple,)). 


Since B is nonsingular on @, we can reformulate the last lemma as fol- 
lows: 


Lemma 4.4. Assume dim a= 1, and let e€ a, e 4 0. Then Ble, e) #0, 
and 


py(uo) = (e? ple)?)/Ble, e) = (e + ple)Me ple))/Ble, e). 


The point is that this holds even if k is not algebraically closed, and 
from now on we can drop the algebraic closure assumption. 

Now clearly e*- ple)? @”, and since this element is quadratic (al- 
though not homogeneous), it generates @”, and in fact @” = ke? - ple)?] is 
the polynomial algebra generated by e? ple)”. But Ug € and p,: 
is an algebra homomorphism. Hence we have: 


Lemma 4.5. The subalgebra ku] of gt generated by uy is isomorphic 
to the polynomial algebra generated by up; p,(kluy]) CQ"; and 
@” is an algebra isomorphism. In particular, »,(S') +e. 


To complete the proof that »,(§) = @” when dim a=1, we need one 
last lemma: 


Lemma 4.6. n @ Kup). 


Proof. Let C be the standard filtration of § and S,(p) 
C S,(p) CS(p) C++» the standard filtration of S(p), so that for all r € Z,, 
Sp) = 9 Sp). The multiplication map in G induces a linear isomor- 
phism § ~ K @XS(p)), and Cg. cK @AS(p)) for all r€Z, (see [1, Propo- 
sition 2.4.15 and its proof]). Thus 


c(EK Ok - OAS(P)C EG (p)). 
Since the decomposition on the right is a €-module decomposition, 
c Gi ntG) S(p)). 
But S(p)* = &L,] (Corollary 3.11), and so 
(+) c Gin S(p)). 
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Now the sum (g* a) £G) + ku ol in the statement of the lemma is direct 
by Lemma 4.5, since ge nN ES C Ker p,. Hence to prove the lemma it is suffi- 
cient to show that Cy C (e' n €G) + ku ol. We shall show by induction on 
réZ, that nN c €8) + ku, This is trivial if r= 0. Assume it 


is true for r. To prove it for r+ 1, note that by (*) it is sufficient to show 
that 


If r is even, we are done because kb, In Ss, +16) = kb ol Ns Ap), and the 
induction hypothesis implies the sited Shiepene r is odd. In =e of the 
induction hypothesis, it is sufficient to show that r+1)/2) (g' 
But 


(Indeed, for all xe S'(g), y€S we have A(xy) = A(x)ACy) (mod 


Again by the induction hypothesis, r=l)/2) EG) + Kul, so that 
= € EG) + 


A final application of the induction hypothesis proves the desired result. 
Q.E.D. 


We now summarize our conclusions for the case dim a = 1. From Lem- 
mas 4.4, 4.5 and 4.6, we have: 


Theorem 4.7, Assume dim a=1. The homomorphism p, : —@ has 
kernel et NtG and image @”. Let by be the canonical quadratic element 
of S(p) associated with the restriction of the Killing form of 9 to } (see the 
end of §3), and let Uy =A(by), so that uy € Then the subalgebra 
of g* generated by uy is isomorphic to the polynomial algebra generated by 
Uo, and py: kup] — @” is an algebra isomorphism. Moreover, 


p, (uy) = (e? ple)?)/Ble, e), 


where e is an arbitrary nonzero element of a. 


Note that we did not have to refer to the general result on Ker p, to 
show that Ker p, = gt NEG when dim a= 1. 

We must finally prove that p,(S") c @™ when dim a is arbitrary. We 
shall do this by applying Theorem 4.7 to certain semisimple subalgebras of 
g associated with the simple restricted roots. 

Assume then that dim a is arbitrary, and fix a simple restricted root a, 
Let m be the centralizer of a in £, and set 


J. LEPOWSKY 
j=t1,+42 j=-2 
where g?%and g~?% might be zero. Then g, is a subalgebra of g. Let 2, 
denote the set of positive restricted roots not proportional to @, and let 


sl 
a 
The simplicity of @ implies that if B€ 2, and y is either a positive re- 
stricted root or a restricted root proportional to a, then B+ye€, if B+ 
is a restricted root. Hence n° is a subalgebra of n, and [gy nC n*, Also, 
setting 9° @9**, we have n= 7, @n* 

We claim that 9, is reductive in g. In fact, Ker@ is a subspace of a 
and hence a subalgebra of g reductive in g. But 9, is exactly the central- 
izer of Ker @ in g. The claim now follows from [1, Proposition 1.7.7]. 

Now Q, is stable under 0, sothat 9,= where €,=9, NF 
and },= 9, MN}. Moreover, 9, is a reductive Lie algebra since it is reduc- 
tive in g. Hence 9, =[g,, Qql is a semisimple Lie algebra and 9,= 9, ®c, 
where ¢ is the center of 9,, and both g, and ¢ are stable under 6. Thus 
if we set 0, =6|g,, €£,= 9, NE, = 9, NP, CME and c_=cNh, 
then (9, 6.) is a semisimple symmetric Lie algebra with symmetric decom- 
position g, = £, ® p,, and we also have c= C,@c_, €,= @c, and 
=f, 

Let x, € @ be the unique element such that B(x;, a) = a(a) for all a€a, 
where B is the Killing form of g. Then a= kx, @Ker a, 


Lemma 4.8. We have 


gi 
j=t1,+2 


c=(c Am) @Ker a. 


In particular, Cy= and c_ =Ker a, 


Proof. Clearly g,, and so g, =(9, Nm @(g, Ilg’*. To 
determine g, M 4, recall that the symmetric bilinear form Bg is nonsingular 
on 9° (see Lemma 3.2),and so we may choose e € g* such that Bale, e) # 0. 
But then Lemma 3.3 implies that [e, 0e] is a nonzero multiple of x,. This 
shows that kx,C 9g, M a. On the other hand, Ker aC c_, and c_ C a be- 
cause 4 is its own centralizer in ). Since a= kx, @Ker @ and (g, nan 


c¢_Cg, N¢ =0, we must have g, 1 4= kx, and C_ = Ker a. The rest of 
the lemma is clear. Q.E.D. 
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Lemma 4.9, Let a, =kx,. Then a, is a splitting Cartan subspace of 
forthe semisimple symmetric Lie algebra (g,, 


Proof. Clearly, @, is an abelian subspace of ), which is reductive in 
9,- We must show that Q, is its own centralizer in },. But from Lemma 4.8, 
the centralizer of Q, in Q, is (9, Am) @a,, and this implies the desired 
result. Q.E.D. 

Let 2, = aa), sothat a, € Then the restricted roots for (g,, 
with respectto 4, are ta, and possibly +20, (depending on whether +20 
are roots for g). Choose &, (and possibly 20,) as the positive restricted 
roots, and let n, be the sum of the positive restricted root spaces in 9). 
Then the corresponding Iwasawa decomposition of 9, is 9, = t ®a, @n,. 
Moreover, N, = N, as previously defined. Furthermore, the Iwasawa decompo- 
sition of 9, is compatible with that of 9, in the sense that €, = g, NF, a, = 
9, aand ny = 

Our goal now is to express the mapping p: § — @ in a form which re- 
lates it to the corresponding mapping for 9). 


Let Na and denote the universal enveloping algebras of Sas 


t., %, and n°, respectively, regarded as canonically embedded in §. Then 


regarding the following equalities as canonical linear isomorphisms, we have 
CG ON*-KOAON, (k-1 
=K®@ON, 


Now let t be an arbitrary linear complement of £, in €, let A: S(g) ~G de- 
note the canonical linear isomorphism, and let S,(t) denote the ideal II, S(d 
of S(t). Then 


K=XAS(d) K, 
(see [1, proof of Proposition 2.4.15]) 


=NMk-1OS, (DOK, =(k- 1 OAS, (DNOK, 
-K, 


G=(K, OAS, @K,) OF ON, © Gn* 
=K, © AS,(d) @K, CON, 


Since clearly 9, = ®a@n,, we have 


C.-K, 
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and so 


Let denote the projection map with respect to this decomposition. 
Then Ker q CKer p, since MS,(v)) C €§ and'Gn*C Gn, and so p=p°g. 

Now 9,= 9, ®c, 9,= @a,@n, and c=c,@c_. Letting 
and denote the universal enveloping algebras of 9), ©, C, and 
C_, respectively, we have 


and 


C=C, 


Let p;: g. ne a, and p,: e- Ml be the projections with respect to these 
decompositions, so that in particular, p, is the mapping for g, analogous to 
the mapping p for §. Now §, = Gg, @C and @= a, @C_, so we havea 
mapping @ 74. 


Lemma 4.10. The maps p, @ p, and 0lS from §, to @ are the same. 


Proof. Let x eG. yé@, and write x = a(mod(€ iS, + gin.) and y= 


b (mod c,@), where ae, and beC_. Then since C centralizes §,, 


xy=ay (mod(€G + 
=ab (mod(€G + §n)),. 
and so p(xy)=ab. Q.E.D. 


Hence we have: 


Lemma 4.11. The map p: § ~@ can be expressed in the form p = 
(p, @p,) 04. 


In order to complete our proof, we have to be more specific about the 
choice of the complement t of ©, in f. 


Lemma 4.12. The subalgebra €, is reductive in g. 


Proof. Since Ker @ is a subalgebra of g reductive in 9 and since 9, 
is the centralizer of Ker @ in g, [1, Proposition 1.7.7] implies that the re- 
striction to 9, of the Killing form B of g is nonsingular and that the semi- 
simple and nilpotent components (with respect to 9) of an element of 9, be- 
long to 9,. Now B(£,, },)=0, so that B is nonsingular on €,. Let x€ €,, 
and let x. and x, be the semisimple and nilpotent components of x, respec- 
tively. Then x,, x, € 9 by the above. But x = 0x = Ox, + Ox,, and since 


Ox. is semisimple, 9x, is nilpotent and [6x,, 0x,] = Olx,, x,]=0, we must 
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have 0x =x, and 0x =x. Hence x, € 9, t= €, and x Nt= 
Thus ©, satisfies the conditions of [1, Proposition 1.7.6], and so €, is re- 
ductive in g. Q.E.D. 

By the lemma, f, is reductive in €, and so we may choose t above to 
be a €.-invariant complement of ©, in €. Then the three summands in the 
decomposition above which defines the projection q are all € qetable {recall 
that [g,, n*] C n*), and so q is a €,-map. In particular, dS' *) = gfe , where 
superscript as usual denotes centralizer. Now since €, = t @c, and c, 


1@C. Hence from Lemma 4.11, we have 


=(p, @ PAG) = 


The conclusion is: 


Lemma 4.13. We have = (81 


We are now in-a position to apply Theorem 4.7. Let 
= (dim +2 dim g2%)a 


and let p., = Pal a,- Then Po is half the sum of the positive restricted roots 
(with multiplicities counted) for g,, and p,|C_=0. Let a, be the affine 
automorphism of @ whichtakes A€ a to s(4+p,)—p, (where s, is the 
Weyl reflection with respect to @), and let y=@ ¢ (in the sense of the begin- 
ning of this section), so that y is an automorphism of a, Also, let a be the 
affine automorphism of a which takes A€ a to -A— 2p), and let 5 = 
(o1,)*: :@,- @.. (Here symbol is used with respect to instead of 
a.) ntti by, @” and @? the respective algebras of invariants. By Theo- 
rem 4.7, 0G, yw ray 1), where W, denotes the (two-element) Weyl group 
of 9, and 7, = a, » Where T: an a is translation by But 


1 
ui 1) is exactly @ 1» SO in pS) y= ae. On the other hand, we have: 


Lemma 4.14. If we identify @ with a. @C_, the automorphism y of @ 
equals 6 @1. 


Proof. Let s‘, be the linear automorphism of a which is the transpose 
of s,. Then s’, is -1 on a, and lon C_. Now y is the automorphism of a 
determined by the condition y(a) = si(a) — 2p,(a) for all a€ a. Also, 6 is 
the automorphism of @, determined by the condition 5(a,) = -a, - 2p(a,) = 
~a,—2p,{a,) for all a, € Let a, € a, and cé€ C_. It is sufficient to 
show that y(a, + c)=5 @1(a, @1+1@c) (regarding @ and @, @C as 
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identified). But 


Ya, +0) = sla, +c) -2p,(a, + c) =-a, -2p,(a,), 
and 


5 @i(a, @1+1@c)=Aa,) O1+1@c 


= (-a, 2p,(a)) ®14+1@c. 
Since these two elements identify with each other, the lemma is proved. 
Q.E.D. 
In view of the lemma, a” = a? ® a and so we can conclude from Lem- 


ma 4.13 and the discussion preceding Lemma 4.14: 
t 
Lemma 4.15. We have p(§ %) = @”; here Q” denotes the algebra of inva- 
riants in @ under the automorphism y = we where a, is the affine automorphism of 
which takes LE to + Pos 


We need one final lemma. Recall that p= % 24 ex, (dim 9?) 
Lemma 4.16. We have s,(p) — p = s,(p,) — py 


Proof. Let =, denote the set of positive restricted roots not proportion- 
alto a. Then the simplicity of & implies that s,2,=2,. On the other 
hand, for all BEX, s,B €> and in fact dim g° = dim 9°@° (see Lemma 2.5). 
Thus 


=-5(dim g*+2 dim g?*)a+5 (dim 
pez, 


and so 


—p =-(dim g* + 2 dim Q-E.D. 


By the last two lemmas, 2G°%) = a”, where y =0¢@ and @,, is the affine 
automorphism of a which takes to s,(A+p):-—p. Recall that r= 
@ — @ where. T: a* — a is translation by p» Then (@”) is the algebra of 
invariants for s¢. Denoting this algebra by @°*, we now have the following 
conclusion: 


Theorem 4.17. In the notation of the beginning of this section, let ae & 
be an arbitrary simple restricted root, define the subalgebra 


2 
j=ti,t2 j=-2 


where g?* and g~?* might be zero, and let €,= 9, NE. Denote by J“ the 
centralizer of €, in J, and by Q@** the subalgebra of @ consisting of the 
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elements  apatapson under the natural action of the Weyl reflection s, on @. Then 


(7 p) (Ch *) In particular, c 


Since W is generated by the simple reflections s,, we can conclude 
that and Theorem 4.1 is proved. Q.E.D. 


5. Appendix. Here we shall give a vector-valued generalization of the 
injectivity of the map F, (see $3). Ina class of important cases (of the 
module V, in the notation below), this generalization is already known (see 
[5, Lemma 4.1], [6] and [1, Lemma 9.2.7, part (b) of the proof]), but in addi- 
tion to being more general, the present proof is elementary in that it does not 
require theory of Lie or algebraic groups. The argument presented here is G. 
McCollum’s simplification of our original proof. 

Let g= £ ®h be the symmetric decomposition of a semisimple symmet- 
ric Lie algebra over a field k of characteristic zero and let a be a Cartan 
subspace of ). Then € acts naturally on ), and thus on {* and on S(*). 
Let V be an arbitrary (possibly infinite-dimensional) €-module. Then since 
S(p*) is naturally identified with the algebra of polynomial functions on }, 
the tensor product £-module S()*) @ V may be identified with a space of 
V-valued functions on }. (In this section, @ denotes tensor product over :k.) 
Similarly, S(a") @V may be identified with a space of V-valued functions on 
a. Let (S(p*) @V) be the space of €-annihilated vectors in S()*) @ V, and 
let FY: (S(p*) @ Vv)’ — S(a*) @V denote the natural restriction map. 


Theorem 5.1. FY is injective. 


Proof. Let /, € (S( b*) @ and suppose FY(f5) = 0. The homogeneous 
components of /, with respect to the decomposition 


S(p*) @V= Il S(p*) @V 
7=0 


are annihilated by €, since the terms in this decomposition are f-stable. 
The components of lo also vanish on 4; this follows from the fact that @ is 
stable under scalar multiplication. Hence it is sufficient to prove that if f 
is a €-annihilated element of 5% )*) ®V for some ré€ Z, and if the restric- 
tion of /, to @ is zero, then /, = 0. 

Recall from $3 the pairing {-,+} between 5% b*) and 5%). Define a 
bilinear map w: (S’(p*) @ V) x S7(p) V by the condition g @v, 
for all g€S’(p*), ve V and s €S’({).In view of Lemma 3.6, @ is a €-map 
in the sense that (x + /, s) + olf, x+'s)=x+ s) forall xe fe S7(p*) 
@V and s€5S"(h). Also, for all fe S7(p*) @V, wlf, S7(p)) = 0 implies = 0. 
Indeed, let {v,} be a basis of V, and write where g,€ S(p*), 
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0= lg, @v, S7(p)) = ig, 


so that S’(p)} = 0 foreach i. By Lemma 3.5(i), each 8; = 9, and so 
{=0. 

Now let T = {2 €S’(p)|@(/,, 2) = 0}. Then T is a €-submodule of 
In fact, if t€ T and €, then x+ t)=x+ - olx + =0 
since t€T and x+ f)=0. But S’(a) C T. Indeed, let a€ a, and write = 
2; for some g;€ S7(p*) and v,€V. Then 


Af os a’) = Lie, a’ = r! g fa)u; =r! =0 


by hypothesis, and the fact that S’(a) C T follows from Lemma 3.5(ii). Thus 
T is a €-submodule of S’(p) containing S’(a), so that T = S’(p) by Lemma 
3.7. (Note that the field extension technique shows that Lemma 3.7 holds 
even when @ is not a splitting Cartan subspace.) That is, w(/,, S’(p)) = 0 
and so /, =0 by the last paragraph. Q.E.D. 
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CONICAL VECTORS IN INDUCED MODULES 
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ABSTRACT. Let g be areal semisimple Lie algebra with Iwasawa de- 
composition g=@a@n, and let m be the centralizer of ain €. A conical 
vector in ag-module is defined to be a nonzero m@n-invariant vector. The 
g-modules which are algebraically induced from one-dimensional (m @a @n)- 
modules on which the action of m is trivial have “canonical generators” 
which are conical vectors. In this paper, all the conical vectors in these 
g-modules are found, in the special case dim a= 1. The conical vectors 
have interesting expressions as polynomials in two variables which factor 
into linear or quadratic factors. Because it is too difficult to determine the 
conical vectors by direct computation, metamathematical ‘transfer princi- 
ples’’ are proved, to transfer theorems about conical vectors from one Lie 
algebra to another; this reduces the problem to a special case which can be 
solved. The whole study is carried out for semisimple symmetric Lie alge- 
bras with splitting Cartan subspaces, over arbitrary fields of characteristic 
zero. An exposition of the Kostant-Mostow double transitivity theorem is 
included. 


1, Introduction. The theory of Verma modules, as developed by D.-N. 
Verma [10(a), (b)] and by I. N. BernStein, I. M. Gel’fand and S. I. Gel’fand 


[1(a), (b)], is becoming increasingly important. Let g be a complex semisim- 
ple Lie algebra and 6 a Borel subalgebra of g. The associated Verma mod- 
ules are the 9-modules induced, in the algebraic sense, by the one-dimension- 
al b-modules (see [2, Chapter 7]). As we shall see in this introduction, a cor- 


responding theory of 9-modules induced from more general parabolic subalge- 
bras of g should also be developed, and the purpose of this paper is to begin 
such a study. 

Here is our main reason for interest in this problem: Let G = KAN be an 


Iwasawa decomposition of a real semisimple Lie group with finite center, and 
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g= € ®a@n the corresponding decomposition of the complexified Lie alge- 
bra of G. Let M be the centralizer of A in K, and m its complexified Lie 

algebra. The infinitesimal nonunitary principal series of G is the family of 

g-modules obtained by taking the K-finite subspaces of the nonunitary prin- 

cipal series representations—those Hilbert space representations of G in- 


duced from the finite-dimensional irreducible representations of MAN (see for 


example [7(a)l). This family of g-modules is of great importance because 


every irreducible g-module which splits into a direct sum of finite-dimension- 
al irreducible €-modules exponentiating to K-modules is a subquotient of an 
infinitesimal nonunitary principal series module (see [4], [7(a)], [9] and [2, 
Chapter 9]). But roughly speaking, the infinitesimal nonunitary principal ser- 
ies modules may be identified with certain ““large’’ subspaces of the contra- 
gredient 9-modules to 9-modules algebraically induced by finite-dimensional 
irreducible modules of the parabolic subalgebra m @ 0 @n of Q (cf. [2, $$9.3.1, 
9.7.10]). Other important families of induced representations of G are simi- 
larly related to g-modules algebraically induced from parabolic subalgebras 
of 

In a sense, the algebraically induced modules may be thought of as mod- 
ules of distributions supported at the identity element of G, and their duals— 
algebraically ‘‘produced’’ modules—as modules of formal power series at the 
identity element of G. The K-finite elements of the produced modules (the K- 
finite formal power series) then correspond to analytic functions on G which 
are also the K-finite elements of the Hilbert space induced representations. 

The Verma modules that can be embedded in a given Verma module are 
completely known ((10] and [1(a)]; see also [2, Théoréme 7.6.23]). Suppose 
one could correspondingly determine the 9-module maps between pairs of 9- 
modules algebraically induced from m © a @®n. Looking at the dual maps be- 
tween the K-finite subspaces of the contragredient modules, one would have 
intertwining operators between nonunitary principal series G-modules, and 
these intertwining operators, which might be Kunze-Stein integral operators, 
would now be given by differential formulas. Furthermore, since an algebrai- 
cally induced module is generated by a “‘highest weight vector’’ (n-invariant 
vector), the g-maps from one of the algebraically induced modules to another 
are closely related to the highest weight vectors in the target module. These 
give rise to highest weight vectors in the dual of the K-finite subspace of the 
Hilbert space induced G-module, and therefore are intimately connected with 
S. Helgason’s conical distributions [5(a), (b)].(7) The submodule structure of 


(2) See also M. Hu’s thesis [12], whose results on conical distributions are re- 
lated to our results on conical vectors. 
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the algebraically induced g-modules must also shed light on the subquotient 
structure of the nonunitary principal series modules (see M. Duflo [3] and [2, 
$9.6] for the case of complex G, using Verma modules), but examples show 
that the relation will be subtle. For instance, irreducibility of the algebrai- 
cally induced module is not equivalent to irreducibility of the related contra- 
gredient nonunitary principal series module. On the other hand, the subquo- 
tient structure of the nonunitary principal series is notoriously complicated, 
but the structure of the algebraically induced modules already appears to be 
more regular and perhaps more fundamental. For example, the inclusion rela- 
tions among the Verma submodules of certain Verma modules recover the in- 
clusion relations among the closures of the Bruhat cells for complex semisim- 
ple Lie groups (see [10]), and it is likely that this situation will generalize 
to real semisimple Lie groups, using the modules algebraically induced from 
m@agn, 

Now that we want to find the highest weight vectors in a given 9-module 
X algebraically induced from a finite-dimensional irreducible (m ® a@ n)- 
module, how do we do it? The following seemed at first like a good starting 
point: Let | be a Cartan subalgebra of m, so that §= | @a is a Cartan 
subalgebra of 9. Let 6 be a Borel subalgebra of 9 containing § and n. 
Then it is easy to see that X is a 9-module quotient of a certain Verma mod- 
ule V induced from © (cf. [2, Lemma 9.3.2]). Hence one can try to use the 
well-developed theory of highest weight vectors in Verma modules to study 
highest weight vectors in X. Unfortunately, however, highest weight vectors 
in V can vanish when one passes to the quotient X, even in simple exam- 
ples. Moreover, it turns out that there are, in general, highest weight vectors 
in X which do not come from highest weight vectors in V. This subtlety, 
which made the problem much more difficult than we expected it to be, forced 
us to work in a relatively special case and to develop new tools to handle 
even this case. 

Now we shall describe our main results, and then we shall say what is 
interesting about our methods. 

By analogy with Helgason’s conical distributions, we call a nonzero vec- 
tor in a g-module (or more generally, in an m™ @ n-module) conical if it is 


m ® n-invariant. The space of conical vectors, together with 0, is called the 


conical space of the module. Let © be the universal enveloping algebra of 3 
and the universal enveloping algebra of m ® a @n. Define p € a* 
(* denotes dual) by the condition p(a) = 4tr(ad ali) for all a€ a, so that p is 


half the sum of the positive restricted roots with multiplicities counted. For 
all vé a’, the linear functional on m @ 2 @n which is zero on m @ N and 
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v—p on 4 defines a one-dimensional representation of m®a@n. Regard- 
ing C as the associated one-dimensional ?-module, and G as a right ?-mod- 
ule by right multiplication, we can form the §-module X” = § @, C. This is 

a “twisted induced module’’ in the sense of (2, $5.2]. The vector x,=1® 
1€X” is a conical vector which generates X”, and is called the canonical 
generator of X”, Let n~ C g be the sum of the negative restricted root spaces 
of g with respect to a, and Jl- CG its universal enveloping algebra. Then 
xX” 

We are aiming for a description of the conical vectors in X” in case G 
has real rank 1, i.e., dim @ = 1. Assume this, and let 2€ a* be the unique 
simple restricted root. Then nm is the direct sum of the restricted root spaces 
g~* and g~?; here g~?* may be zero. There are natural M-invariant non- 
singular symmetric bilinear forms on g~* and Let and 
€Jl~ be the sums of the squares of orthonormal bases of g~* and g~?%, re- 


spectively, so that q_, and q_,, are quadratic M-invariant elements of iw 
and q_,,=0 if g~?% = 0. Let (Ji-)™ be the algebra of all M-invariants in 

N-. Then (Ji-)" is a polynomial algebra on either one or two generators, de- 
pending on whether g~?%=0 or g~?%¥# 0 (see $5), and in the difficult case 
when dim g~?*> 1, the two generators are q_, and q_,,; this follows from 


the Kostant-Mostow double transitivity theorem (see $4) on M-orbits in n7 
(or more precisely, M-orbits in the intersection of n~ with the real Lie alge- 
bra of G). With this as background, we now state our main results (see $10): 


Theorem 1.1, Assume dim a=1 and let ve a*., Then the conical space 
of X” is either one- or two-dimensional, according to whether v is a positive 
integral multiple of a (of 4a if dim g* = 1) or not. If v is not of this form, 
then the conical space of X” is spanned by the canonical generator X_ of 
X”. Suppose v = la, | a positive integer. (If dim g°=1, take instead v = 
Y’la.) Then q_, and q_ 2q Can be suitably renormalized (independently of i) 
so that the following is true: Suppose dim g* > 1. Define Cré Ni- by the 
formula 


+ l even, 


Gia II + 29)» odd. 


j=2;j even 


If dim g*= 1, define ¢,=fieN-, where { is a nonzero element of g~*. 
Then the conical space of X” has basis \xo, F * Xo}. Moreover, the g-sub- 


module of X” generated by ¢ + xq is isomorphic to X~”. 


| 
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Theorem 1.2. Let p, ve a. Then dim Hom,(X", X”) <1. Moreover, 
dim Hom,(X", X”) = 1 if and only if either p= v, or else p=-v and v isa 
nonnegative integral multiple of a (of 4a if dim g°= 1). This is exactly 
the case in which X” is isomorphic to a g-submodule of X”. 


(The annoying exceptional case dim g*= 1 in these two theorems is es- 
sentially the case G = SL(2, R), and is trivial.) 

Considering how rare it is for a polynomial in two variables to factor 
into linear or quadratic factors, the factored form of the g 1 in Theorem 1.1 
seems remarkable. We shall say more about this below. 

It turns out that Theorem 1.2 follows easily from Theorem 1.1, so we 
shall explain what is involved in proving Theorem 1.1. First, it is easy to 
see that the space of m-invariants in X” is the space (1-)" . Xo (here (i-)" 
is the space of M-invariants in Ji- and equals ()l-)™). From the above, 
(-)" is a polynomial algebra in one or two generators. If 97% =0, we have 
one generator, and Theorem 1.1 is not terribly hard in this case (see $6). 
Suppose now that dim g** >1, so that (JI-)" is the polynomial algebra 
Clq_., 7.2,]. The whole problem is to determine those polynomials p in 
two variables such that as * is N-invariant. Clearly, this in- 
volves computing commutators of elements of nt with g_, and 4_,,, and 
also commutators of these commutators with q_, and q_,,. We were able 
to compute the necessary commutators (see $$6, 7), but the resulting condi- 
tion on the polynomial p is immensely complicated, and it is not feasible to 
analyze it directly (see the last remark in $8). 

However, when attempting to unravel this condition on p for some spe- 
cial G’s, we noticed that the computations, even though we could not do them 
for any one G, did not seem to depend on G. The key was then to prove @ 
priori that the conical vectors would look the same for any one G (for which 
dim 9** > 1) as for any other such G, and then to use possibly special meth- 
ods to solve the problem for one ‘‘small’’ G. Specifically, we first proved 
what we call the ‘‘fundamental commutation relation in JI~’’: There is a non- 
zero constant c €C such that [[/, ¢_a] =c/¢_7, forall € g~* (see 
Theorem 7.4). This is called ‘‘fundamental’’ because of the next result: If f 
is chosen more carefully, then this relation and a trivial one ([/, ¢_ on! = 0) 
generate ail relations which are linear in / in the associative subalgebra of 
Ji- generated by f, q_, and q_,, (see Theorem 8.1). This in turn implies 
the following metamathematical ‘“‘transfer principle for If 
b,, ++. , 6, are complex polynomials in two variables, then the truth of any 
assertion of the form a{q_ =9 in is in- 
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dependent of G (see Theorem 8.4). But the condition that ~(q_,, 9_>,)* Xo 
be conical in X” can be expressed in this form (see Lemma 8.5), where the 
a. and b; depend only on p and the complex number such that v= ca. 
Thus we could prove the “‘transfer principle for conical vectors’’, another 
metatheorem which says that if * Xq is conical in for 
some G with dim 9?%> 1, then the same is true for any such G (see Theo- 
rem 8.6). Furthermore, the above metatheorems have analogues for the case 
dim 92% = 1, enabling us even to transfer theorems about conical vectors 
from any one G with dim 92% =1 to any G with either dim g** = 1 or 
dim 97% > 1 (see Theorems 8.4 and 8.6). 

The conical vectors still had to be computed for some special G with 
dim 97% > 1. The only cases which we were able to do directly, aided by a 
crucial observation of L. Corwin, were the cases G = SU(n, 1)—essentially 
all the G’s such that dim g?% = 1. In these cases, (JI-)" is the polynomial 
algebra in q_. and r 


-2q Where r_,, is a nonzero element of the one-dimen- 


sional space We reformulated the condition that be 
conical in X” (where p is a complex polynomial in two variables) in terms 

of a complicated system of linear equations whose unknowns were essentially 
the coefficients of p. These equations implied uniqueness of the conical vec- 
tors, but it was not clear that the equations had a consistent solution (and 
hence it was not clear that the conical vectors in Theorem 1.1 existed) until 
Corwin noticed that a solution vector could be constructed from the coeffi- 
cients of a certain polynomial which factored into certain linear factors. This 
meant that if p were this polynomial, then p(q_., r_ 2a) * X9 would be coni- 


cal. This was enough to prove Theorem 1.1 for these G’s. To place the case 


dim 97% =1 in perspective, we further note the following: In this case, nae 


= 4_>, in Ji-, and therefore the factors qt re... in Theorem 1.1 them- 
selves factor into linear factors: + (-1)'/?jr_ (-1)'/?jr_,). 
It was this which made it feasible to carry out the necessary computations 
(see the Remark following Lemma 9.1), 

Actually, in writing up the special case in $9, we dealt only with G= 
SU(2, 1), and following a suggestion of N. Wallach, we used the theory of 
Verma modules to prove the uniqueness of the conical vectors. (For G= 
SU(2, 1), the g-module induced from m @a@n is actually a Verma module, 
not just a quotient.) Thus the original approach, using the complicated sys- 
tem of linear equations, is not carried out in this paper. 

The above results are stated for G of real rank 1, but they imply a result 
for arbitrary real rank, included in Theorems 10.1 and 10.2. 
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There is another direction in which Theorems 1.1 and 1.2 are extended in 
this paper—to arbitrary fields of characteristic zero. In fact, throughout this 
paper, we work with semisimple symmetric Lie algebras with splitting Cartan 
subspaces, over fields of characteristic zero (see [2] and [7(b)] for back- 
ground on these). This accounts for most of the length of §$2-4, in which 


we wanted to give a self-contained elementary treatment of the Kostant-Mos- 


tow double transitivity theorem and its consequences for algebras of polyno- 


mial invariants, valid over general fields of characteristic zero, without using any 
theory of Lie or algebraic groups. Instead of group orbits, we use “‘infinitesi- 
mal transitivity and double transitivity’? conditions. We essentially give Wal- 
lach’s modified version of Kostant’s proof of the double transitivity theorem. 
See $$3 and 4 for a more detailed discussion of this theorem and its conse- 
quences. 

Incidentally, it is not surprising that theorems about real semisimple Lie 
algebras, Cartan decompositions and Iwasawa decompositions should also 
hold for more general semisimple symmetric Lie algebras, since joint work 
with G. McCollum has shown that assertions about such structures whose 
truth is preserved under field extension and restriction are true for any one 
field of characteristic zero if and only if they are true for any other; see [8(e)]. 
This gives a generalization of H. Weyl’s “‘unitary trick’’, which enables one 
to transfer theorems from compact semisimple Lie algebras to semisimple Lie 
algebras over arbitrary fields of characteristic zero. 

After the work for this paper was completed, we found a simpler proof of 
the uniqueness of the conical vectors, avoiding the use of the double transi- 
tivity theorem; see [8(d)]. (But the existence and explicit form of the conical 
vectors still require the fundamental commutation relation and transfer prin- 
ciples.) This proof uses an observation of Kostant on the limitations imposed 
on conical vectors by the action of the center of G. The proof also uses an 
a priori argument that the first assertion of Theorem 1.2 holds—that 
dim Homg(X", X”) < 1. In fact, we have generalized this last inequality toall 
parabolic subalgebras (see [8(c)]) by extending the method that Verma origi- 
nally used (see [2, Théoréme 7.6.6]) to prove the corresponding fact about 
Verma modules. 

We remarked above that a g-module X induced from a finite-dimensional 
irreducible (m © a @n)-module is a quotient of a certain Verma module V, 
but that one cannot very well use V to determine the highest weight vectors 
in X. On the other hand, since Theorems 1.1 and 1.2 are true, we can use 
them as a tool in investigating the composition series of the Verma module V. 
Interesting things happen: First, recall that in [1(a)], BernStein, Gel'fand and 
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Gel'fand found an example of a Verma module for 2((4, C) having two strange 
properties: It contains a proper submodule not generated by Verma submod- 
ules, and its composition series contains a certain irreducible subquotient 
with multiplicity two. But it now turns out that if one regards (4, C) as the 
complexification of %u(3, 1), then one can explain all of this pathology by 
means of the existence of a certain conical vector in X which does not come 
from a highest weight vector in V. In effect, BernStein, Gel'fand and Gel'fand 
were actually dealing with the case /=1, ¢, = q_, in Theorem 1.1. Moreover, 
using Theorem 1.1, we can generate whole families of examples of the same 
two ‘‘strange’’ phenomena for many Lie algebras. Thus a “‘bad’’ phenomenon 
for Verma modules becomes “good’’ when one interprets the situation using a 
larger parabolic subalgebra than a Borel subalgebra. This further emphasizes 
the importance of studying modules induced from general parabolic subalge- 
bras. 

Along the same lines, we comment that the results of [1] and [10] do not, 
in general, give explicit expressions for the highest weight vectors in a Verma 
module, or equivalently, explicit formulas for the embedding of one Verma mod- 
ule into another; they usually give only the existence of the vectors or the em- 
beddings. But we can use the polynomials ¢) in Theorem 1.1 to give explicit 
expressions for certain of these highest weight vectors or embeddings which 
have not yet been described explicitly. 

We would like to thank G. D. Mostow for informing us about his approach 
to the double transitivity theorem. 

Notations. We shall write Z, for the set of nonnegative integers and Q 
for the field of rational numbers. Throughout this paper, k is a field of char- 
acteristic zero. The dua! of a vector space V over k is denoted V*. The 
symmetric algebra of V is written S(V), and for all r € Z,, the rth symmetric 
power is denoted S’(V), so that 

S(v)= JJ s7(v). 

S(V*) is naturally isomorphic to the algebra of polynomial functions on V 
(i.e., the algebra of sums of products of linear functions on V), and we shall 
often identify these two algebras. Let g be a Lie algebra over k, and let V 
be a g-module. Then 9 may be canonically embedded in the universal envel- 
oping algebra G of g, and V may be regarded naturally as a G-module. The 
action of § on V will be denoted x+v(xeQ, veV). If Sand T are sub- 
sets of g and V, respectively, let T* be the set of %invariants in T, i.e., 
{te T|s+¢=0 forall se 8}. Regard § and S(g) as g-modules by the nat- 


ural extensions by derivations of the adjoint action of g on itself. Then for 
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x€g and ye, x-y=[x, y], where we use [+ ,+] to denote the commu- 

tator in associative algebras, as well as the bracket in Lie algebras. In par- 
ticular, if 8C g and TCG, then T* is the ordinary centralizer of 2 in T. 
Note that for all x€ 9, y€G and veV, we have x-(y+v) =[x, ylev+y-> 
(x + v). Regard V* as the g-module contragredient to the g-module V. 


2. The setting. Here we shall summarize the necessary preliminaries 
and fix notation to be used throughout most of this paper. 

Let (g, 0) be a semisimple symmetric Lie algebra over k, i.e., 9 isa 
semisimple Lie algebra over k and @ is an automorphism of 9 such that 
6? = 1. (See [2] and [7(b)] for background information on semisimple symmet- 
ric Lie algebras.) Denote by € and $ the +1 and -1 eigenspaces for 0, 
sothat g= € @b is the symmetric decomposition of (g, 9), orthogonal with 
respect to the Killing form of g. Assume that there is a splitting Cartan sub- 
space @ of }. That is, @ is a maximal abelian subspace of } whose ad- 
joint action on g can be simultaneously diagonalized. 

Let m be the centralizer of a in €, and for all k-linear functionals 


go: a—k, define 


= {xe g|la, x] = d(a)x forall ae a}. 
Then g° =m@a. Let 
40 and g? ¥ 0}, 


the set of restricted roots of 9 with respect to a. Then 


per fez 


Moreover, [g?, g? and 0g? = for all ¢, We a*. 

Let B be the Killing form of g. Then B is nonsingular on a (see [7(b)]), 
so that B induces naturally a nonsingular symmetric k-bilinear form (+,+) 
on . as well as a natural isometry between a and a*. Let a. denote the 
rational span of in Then a” is naturally isomorphic to @q and 
the form (+,+) is rational-valued and positive definite on the rational space 
a6 (see [7(b)]). In particular, (¢, d) # 0 for all GES. 

For all de, let S4 denote the orthogonal reflection of a* through the 
hyperplane perpendicular to ¢, and let W be the group of isometries of a* 
generated by the s4 (p€ =). W is called the restricted Weyl group of g with 
respect to a, = spans a” and forms a (not necessarily reduced) system of 
roots in a” with Weyl group W (see [7(b), $2)). 


Let 2, be a positive system in 2, and define 
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n= ll g? and n= Ll 
per, pez, 

Then n and nm” are nilpotent subalgebras of g, and we have the decomposi- 
tion g= 

Define the bilinear form Bg on g by the condition B(x, y) = —B(x, Oy) 
(x, y€g). Then Bg is a nonsingular symmetric form, and the decomposition 
g=m@a® User g? is a Bg-orthogonal decomposition (see [7(b), Lemma 
3.2]). Hence Bg is nonsingular on each g? (¢€=) on m and on a. More- 
over, By isclearly a ‘€-invariant and 0-invariant form on g. 

For all dex, let x4 € @ denote the image of ¢ under the canonical 
isometry from a” to a, so that B(x 4, a) = $(a) for all a€ a, and B(x 4, xy) 
=(¢, W) for all d, WE. Then for all e € g?, [e, Oe] € a, and in fact 


[e, Oe] = Ble, 4 =-B e)xy 


[7(b), Lemma 3.3]. Since (d, 6) 0, we can define by = 2x4 /(¢, € a. 
Then = 2. 


Suppose now that & is algebraically closed, so that every element in k 


g? 


tains a nonisotropic vector ¢, with respect to the form Bg (i.e., Bglep, eo) 
# 0). Set 


has a square root. Since Bg is a symmetric nonsingular form on g con- 


eg = (2/(g, $)Bgley, e,))'/2e, 


and =—Oe,. Then Bgley, ey) = 2/(p, >), and so [hy, eg] = 2e4, [hg, 
=-2/4 and ley, fg) = hy. Hence thy, spans a three-dimensional sim- 
ple subalgebra u, of g. 

Now drop the algebraic closure assumption on k. Let § be the universal 
enveloping algebra of g, and let M, @, N and i- denote the universal en- 
veloping algebras of m, a, n and mn’, respectively, regarded as canonically 
embedded in g. Then the multiplication map in induces a linear isomor- 
phism 


Let v€a™. Then the linear form on the subalgebra m @aA@n of g 
which is v on @ and zero on m @M vanishes on the commutator subalgebra 
of m ®a@n, and thus corresponds to a one-dimensional representation 7 
of m ®a @n and hence of its universal enveloping algebra MQM. Let V” 
be the g-module induced by the (m@®a@n)-module defined by 7 (see [2, 
§5.1]). That is, 
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where § is regarded as a right M@)-module by right multiplication, and k 
is regarded as the M@N-module defined by 7. The vector 
generates V” as a §-module, and is called the canonical generator of V”. 

It is clear that the map @: N-— v’ given by xx + vp is a linear isomor- 
phism. 

Let V be a g-module, v € V a nonzero vector and A€ a*. Then v is 
called a restricted weight vector and A a restricted weight for V if x+ v= 
Mx)v for all x€ a, For all A€ a*, the subspace of V consisting of 0 and 
the restricted weight vectors for A is called the restricted weight space for 
A; it is nonzero if and only if A is a restricted weight for V. 

The following definitions are central to this paper: Let V be a 9-mod- 
ule, and let v€ V be nonzero. Then v is a conical vector for V if ve * deco 
ice., if (m @n)+ v= 0. The subspace consisting of 0 and the conical 
vectors is called the conical space of V. 

Now ler v € a* and let Va be the canonical generator of the induced 
module V”. Then vp is clearly a conical restricted weight vector in V” with 
restricted weight v. It is also clear that the conical space of V” is a-invari- 
ant and hence is the direct sum of its intersections with the restricted weight 
spaces of V”, 

The standard universal property of the induced module V” (see [2, $5.1]) 
say that if U is a g-module and wé€ U is a conical restricted weight vector 
with restricted weight v, then there is a unique 9-module homomorphism 
{: V” such that /(v)) =u. If u generates U, then is surjective. If 
U = V” for some p€ a*, then f is injective; this follows from the fact that 
Ji- has no zero divisors. Let ZC V" be the intersection of the conical 
space and the restricted weight space for v. Then we have a natural linear 
isomorphism 


Hom,(V",V") > Z, f(v9). 


Let v and vy be as above. Since vy€(V”)", the linear isomorphism 
@:N-—V” (see above) is also an m-module isomorphism, where JI- is 
regarded as an m-submodule of © under the adjoint action. In particular, 
(v’)" =(-)"- vo, and in fact @ restricts to a linear isomorphism 

Vo: 

Define p€ a” by the formula 


pla) = Yer(ad a| n) 


230 J. LEPOWSKY 


for all aé a, i.e., 


For all v € a*, define the g-module X” to be the induced module V’~*, As 
above, let 7 be the one-dimensional representation of m ®@ a ® n defined by 
v. Then X” can be interpreted as the twisted induced module induced by the 
one-dimensional (m © a @ n)-module corresponding to 7, in the sense of [2, 
$5.2]. That is, forall mem, a€ a and né n, the trace of the action of 
m+a+non 9/(m@®a@n) is -tr(ad aln) =-2p(a). But we shall not need 
this fact. 


The canonical linear isomorphism : S(g) > G is defined by the formula 


1 
a) == 8o(1) °** So(n) 
7! fon 


for all née Z, and 8; € 9; here the product on the left is taken in S(g), the 
products on the right are taken in G, and o ranges through the group of per- 
mutations of {1,..., n} (see [2, $2.4]). For all g€gand née Z,, Ag”) = 
g”. Also, A is a g-module isomorphism (see [2, $2.4.10]). 

Let k be a field extension of k, J = 9 ®, k, taf ®, k, etc., and let 


6 be the.k-linear extension of 9 to 9. Then (J, @) is a seniaingle symmet- 


ric Lie algebra over k with symmetric decomposition § = £@ , a isa 
splitting Cartan subspace of }, etc. We shall often use the technique of ex- 
tension to a ‘‘sufficiently large’’ field k, which can always be taken to be 
an algebraic closure of k. For example, the construction of the _Subalgebra 
uy above might have to be carried out over an extension field k of k, but 
results about (9, 0) proved using Uy can often be transferred to (g, 4). 


3. General results on polynomial invariants. Let U be a finite-dimen- 
sional real Euclidean space and SO(U) the rotation group of U. There is a 
natural SO(U)-invariant quadratic element t of the second symmetric power 
S?(U*) given by the sum of the squares of the members of the dual basis of 
any orthonormal basis of U (¢ is the ‘‘square of the radius’’). Let I be the 
algebra of SO(U)-invariant polynomial functions on U, or equivalently, the 
algebra of SO(U)-invariants in the symmetric algebra S(U*), A standard re- 
sult of classical invariant theory states that | is exactly the set of polyno- 
mials in ¢ if dim U>1. (If dim U=1, then SO(U) acts trivially on U, and 
so I = S(U*).) 

Clearly, | is exactly the set of polynomial functions on U constant on 
the SO(U)-orbits in U, i.e., the spheres centered at the origin if dim U> 1, 
and the points if dim U=1. If M is any Lie group which acts as isometries 


p-> (dim 
2 get, 
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on U in such a way that M acts transitively on the SO(U)-orbits in U (i.e., 

the M-orbits in U are the same as the SO(U)-orbits), then the set of M-invari- 
ant polynomial functions on U must coincide with the set | of SO(U)-invari- 
ants. 

Now suppose that M also acts as isometries on a second finite-dimen- 
sional Euclidean space V so that M acts transitively on the SO(V)-orbits in 
V. Then the set of M-invariant polynomial functions on V is the set ]CS(V*) 
of SO(V)-invariants, and J is a polynomial algebra as above. 

Now M and SO(U) x SO(V) both act naturally on U@®V. Let L be the 
set of M-invariants in S((U ® V)*) = S(U*) @ S(V*). It is easy to see that the 
set of SO(U) x SO(V)-invariants in S((U ® V)*) is exactly 1 @J, and that 
1@JCL. It is important to know that | @J =L in certain situations. In this 
case, for example, L will be a polynomial algebra on two generators. In order 
to insure this, it is natural to assume that the M-orbits in U ® V are the same 
as the SO(U) x SO(V)-orbits, i.e., the products of the SO(U)-orbits in U with 
the SO(V)-orbits in V. This assumption is equivalent to the ‘‘double-transi- 
tivity” hypothesis—that if A is an SO(U)-orbit in U and B is an SO(V)-orbit 
in V, then the isotropy group of M at any point of A acts transitively on B. 
If dim U>1 and dim V > 1, this is equivalent to saying that M acts transi- 
tively on the product of the unit sphere in U with the unit sphere in V. Under 
the double transitivity hypothesis, L =] @]J. 

The present section is devoted to algebraic analogues of these facts, 
valid over the field k of characteristic zero, assumed for convenience to be 
algebraically closed throughout this section. Here we are concerned with a 
Lie algebra m, (over k) which acts on modules U and V with nonsingular 
symmetiic ™>-invariant bilinear forms. Replacing the orbit hypotheses for M 
by corresponding ‘“‘infinitesimal transitivity and double-transitivity’’ assump- 
tions, we show that the ™)-invariant polynomial functions on U, V and U®V 
are exact analogues of the spaces of M-invariants above. We also transfer 
these results to the symmetric algebras S(U), S(V) and S(U ®V) = S(U) @S(V); 
the invariants here are essentially the same as for the spaces of polynomial 
functions. We do not need any theory of algebraic groups. The setup in this 
section is entirely independent of $2; the results here will be applied to the 
setting of §2 in the next section. 

Let m, be a Lie algebra over k, U a nonzero finite-dimensional m)-mod- 
ule, and By a nonsingular symmetric m,-invariant bilinear form on U. The 
homogeneous quadratic polynomial — x b+ B(x, x) on U defines a 

) 


canonical nonzero element ty € s%{u under the natural identification be- 


tween the algebra of polynomial functions on U and s(U*). By also induces 
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a canonical -module isomorphism U* — U which extends to an 
module and algebra isomorphism s(u*) — S(U). Let Po= to)» so that 

For every element e € U, denote by e+ the B,-orthogonal complement of 
e in U. Recall that e is called isotropic (resp., nonisotropic) with respect 
to By if Bye, e) = 0 (resp., B,fe, e) # 0). Note that e is B y-nonisotropic 
if and only if U = ke @ e*. 


Lemma 3.1, For all e€ U, et, 


Proof. Let x€ mp). Then + e, e) = -B le, x +e) e, e) 
since By is Mp-invariant and symmetric, and so -e,e)=0. Q.E.D. 

We now make the key assumption that for every By-nonisotropic vector 
eé€U, we have M)+e= e+. This can be thought of as an “‘infinitesimal 
transitivity’’ hypothesis. Our goal now is to compute s(u)"®, and in fact to 
prove: 


Theorem 3.2. If dim U =1, then s(u)'° = S(U). If dim U > 2, then s(u)"° 
is the polynomial algebra generated by py. In particular, s(u)"° is a polyno- 
mial algebra on one generator. 


The proof will be carried out in a series of lemmas. First we settle the 
easy one-dimensional case: 


Lemma 3.3. Suppose dim U=1, Then mp acts trivially on U. In parti- 
cular, S( u)"? = S(U). 


Proof. Any nonzero element e of U is By-nonisotropic, and so e+ =0. 
Thus e=0 (Lemma 3.1). Q.E.D. 


It is also convenient to handle the two-dimensional case separately: 


Lemma 3.4. Suppose dim U = 2. Then S(U)'® is the polynomial algebra 
generated by po. 


Proof. Since k is algebraically closed, we may choose a B p-orthonormal 
basis {e,, e,} of U. Then py +e €S*(U). By hypothesis, there exists 
such that x+e,=e,. Since By is Mp-invariant, we have Boley, 
=-B {x - e,) = -B e,) =-l. But x-e, is a multiple of e,, and so 
Xe es =-e 

Again since k is algebraically closed, k contains a square root i of 
Let v,=e,+ ie, and -ie,, so that v,} is a basis of U. 
Then x+v,= =-iv, and x+v,=e,+ ie; =iv,. 

Let f € S(U)"°. Then / is a polynomial of the form 


CONICAL VECTORS IN INDUCED MODULES 
B 
= v 
a BEZy “ap 
in v, and v, (cag €k). Since x - {=0, we have 
> ica = 0, 
a, BEZ, 
so Cap =0 unless a =f. Thus But viv, 
+ 
+ = po, and so isa polynomial i in Po. Conversely, it is clear that any 
witatedielel in py is in S(U) "0. ‘The lemma now follows from the fact that the 
subalgebra of S(U) generated by p, is isomorphic to the polynomial algebra 
generated by pp. Q.E.D. 


In order to compute S(U) yo in general, we shall use the following result: 


Lemma 3.5. Let e€ U be B,-nonisotropic, and let r€Z,. Then gen- 
erates S’(U) as an ™,-module. In particular, 


S*(U) = ke” + my S7(U). 


Proof. The second statement clearly follows from the first, and so it is 
sufficient to prove by induction on j=0,..., 7 that the smallest m-invari- 
ant subspace T of S’(U) containing e” also contains e’~/Se+). This is 
clearly true for j= 0, so assume it is true for 0,..., j (j<7). Let x€m) 
and s € Se). Then 


The left-hand side and the second term on the right are in T by the induction 
hypothesis, and so e7~ +x. e)s€T since r—j>0. The lemma now fol- 
lows from the assumption that Mp) + e = e+, Q.E.D. 

The point is the following: 


Lemma 3.6. Let e€ U be B,-nonisotropic, ré Z, and f € Ree 
gard { as a polynomial function on U. Then { is determined by its value at 
e. Equivalently, if {(e) =0, then f=0. 


Proof. There is a natural pairing {-,+} between S’(U*) and S’(U) given 
as follows: 


if, fs uy I] (f»» i))> 


where w,,...,4u,€U, U*, {+,+) is the natural pairing between 
U* and U and o ranges through the group of permutations of Uf, ace 5 
Then {/, uw} =1r!/(u) for all / €S7(U*) and U, where is regarded as a 
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polynomial function on U on the right-hand side. It follows that {-,+} is 
nonsingular. Also, the natural actions of mp) on S7(U*) and S7(U) are con- 
tragredient with respect to {-,+} (see for example the proof of [ 7(b), Lemma 
3.6]). 

Now let { and e be as in the statement of the lemma. If /(e) =0, then 
if, Since is mp-invariant, x s}=-{x +f, s}=0 for all x€ my 
and s € S’(U). Thus {/, S’(U)} = 0 by Lemma 3.5, and so /=0 by the non- 
singularity of {+,+}. Q.E.D. 

Theorem 3.2 now follows by applying the canonical isomorphism ¢, : su*) 
— S(U) to the following result: 


Lemma 3.7. Let dim U > 3. Then s(u*)° is the polynomial algebra gen- 
erated by tp. Equivalently, if r€ Z, is odd, then st(u*)"? = 0, and if r= 
2m, me Z,, then is spanned by 


Proof. Since s(u*) ° is the direct sum of its homogeneous components, 
it is sufficient to compute S™(U*)"° for re Z,. Let VCU be the algebraic 
set defined by the equation t)(v) = 0 (ve U). Then V is exactly the set of 
B,-isotropic vectors in U. Let f € s7(u*)" °. If { has a zero outside V, then 
{= 0 by Lemma 3.6. Hence we may assume that all the zeros of / lie in V. 
But then by the Hilbert Nullstellensatz, / divides some power of ty. Choose 
a B,-orthonormal basis of U, and let Xi U* be the corresponding 
dual basis. Then S(U*) can be identified with the polynomial algebra 
HX, ...,X], and to Since dim U > 3, ty is an irreduci- 
ble polynomial. The fact that / divides a power of ¢, thus implies that / is 
itself a power of t, upto a scalar multiple. Q.E.D. 

Theorem 3.2 is now proved. 

Remark. The last assertion of Lemma 3.7 (the case r= 2m) can also be 
proved more directly (even when dim U < 2) as follows: Let f{ € s*(u*y °, 
let e € U be a By-nonisotropic vector, and set c = (t7')(e) = tole)” € k. Since 
tole) = Bole, e) # 0, we have c # 0. But /(e)t7 and cf are two elements of 
(uty ° which take the same value c/(e) at e. Hence f= cl f(e)e™ , by 
Lemma 3.6, proving the assertion. 


The following consequence is interesting, but it will not be needed: 


Corollary 3.8 (to Theorem 3.2). Every m)-invariant symmetric bilinear 


form on U is a scalar multiple of By. 


Proof. From Theorem 3.2, = and so = kt). The 
corollary now follows by polarization. Q.E.D. 
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Remark. Corollary 3.8 has a direct proof which does not use either Lem- 
ma 3.4 or Lemma 3.6: Let C be an mp-invariant symmetric bilinear form on 
U. Then the unique linear operator A: U — U defined by C(u, v) = By(Au, v) 
for all u, v€ U is an M)-module map which is symmetric with respect to Bo. 
Let e€U be a By-nonisotropic vector, and let 


exists x€M, such that x+ e= e’. Then 


By hypothesis, there 


B (Ae, e’} = By(Ae, x + e) = ~By(x + Ae, e) = -B (A(x - e), e) 
= -B (Ae’" e) =-B, fe, Ae’) = -B (Ae, e’), 


and so BfAe, e')=0. Thus every B y-nonisotropic vector of U is an eigen- 
vector for A. Since every two B,-orthogonal By-nonisotropic vectors have a 
B,-nonisotropic linear combination not proportional to either of them, we see 
that they must have the same eigenvalue for A. Applying this to a B)-orthog- 
onal basis of U consisting of By-nonisotropic vectors shows that A is a sca- 
lar, and this completes the proof. 

Another general result is required for the next section. Let V be a non- 
zero finite-dimensional m o-module with a nonsingular symmetric Mp-invariant 
bilinear form B,. Let p, € sy)" ° be the corresponding canonical invariant. 
The symmetric algebra of the direct sum M)-module U @ V is naturally iso- 
morphic to S(U) ® S(V), and my acts on su ® V) according to the tensor 
product of its actions on S(U) es S(V). In particular, S(U)"° @ s(v)"° 
CSU ® v)° - The next theorem gives an important case in which this inclu- 
sion becomes an equality. 


Theorem 3.9. In the context of Theorem 3.2, suppose in addition that for 
every By-nonisotropic vector e, € U and every B,-nonisotropic vector e, € V, 


we have mo -e,= aT in V, where Mo is the centralizer of eg in Mo. Then 


@ = ° @ SV) 


s(uy"° is given by Theorem 3.2, and S(v)'° is either S(V) or the polynomial 
algebra generated by p,, depending on whether dim V =1 or dim V>2. In 
particular, S(U ® V) "0 isa polynomial algebra on two generators. 


Proof. Let e, € U be By-nonisotropic, and let Mo be the centralizer of 
in Mo. For every B ,-nonisotropic vector € V, we have 
My e,C by Lemma 3.1, so that mM) e, = ey: Thus Theorem 3.2 applies 
to Mo, 'V, B, and | Py, and so to prove the salle all we must show is that 
SU @ VI? CSU? @ 

We shall now apply a technique used in [7(b), $5]. It is clear that 
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S(U ® V) ° is the direct sum of its homogeneous components of the form 
(s7(U) @ s(y)y"?, where r€ Z,, and so it is sufficient to show that 
(st(U) S(V)) @ HV). 

Recall the nonsingular mp-invariant pairing {-,+} between S’(U*) and 
S7(U) (see the proof of Lemma 3.6). Also recall the canonical m)-module and 
algebra isomorphism &,: S(U*)—*S(U). Then restricts to an mo-module 
isomorphism Define a bilinear map 


@: S7(U) @ S(V) x S7(U) S(V) 


by the condition s@w, th thw for all s, t€ S’(U) and we S(V). 
Then for all x € mp, y € S’(U) @ S(V) and t€S’(U), we have 


Ax y, + aly, x- t) aly, 


Moreover, let X be any subspace of S(V). We claim that for all y € S’(U) ® 
S(V), oy, S7(U)) CX implies y € S7(U) @ X. In fact, choose a basis {w } for 
a complement of X in S’(V) and write y=2,5,@w,+z(s,€S7(U), z € 
S’(U) X). Then for all t € S’(U), we have 


and so >. AésXs), tlw,€X. Hence $7(U)} = 0 for all i, so that 
each s,=0, proving the claim. 

Let y €(S7(U) @ S(V)) "0 and let €, and m) be as in the statement of 
the theorem. Then for all x € Ms 


x + aly, = alx + y, eG) + oly, r(x een”) =0 

since x+ y=0 and x+e,)=0. Hence oly, ef) € s(v) But by hypothesis, 
m5° e,= et in Y, for every B ,-nonisotropic vector e, € V. Thus Theorem 
3.2 applies ,to Moy | V, B, and p,, as well as to Mo, v, B, and p,. In partic- 
ular, S(V) S(v) "0 so ly, ef) € S(V) "0. But the set Z of B 
tropic vectors in U is Zariski Pies since it is the set on which the polyno- 
mial function ty € S*(U*) does not vanish. Hence the'powers e (e, € Z) 
span an (see for example [7(b), Lemma 3.5(ii)]). It follows } a SU) 
C S(V)'°. But now the above claim applied to X = S(V)"° implies that y € 
@ (VI, 

The rest is easy: Let {a} be a basis of S(v)°, and write y=, 6, 
a, (b,€ S’(U)). Since mg + y =0, we must have * +b, @a;=0 for all 
Mo, so that + b,=0 foreach i. Hence ye S™(U) s(v) "0 and the 
theorem is proved. Q. E.D. 


= 
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4, The Kostant-Mostow double transitivity theorem. In this section, we 
return to the setting of §2. For every ¢ € 2, m acts naturally on the subal- 
gebra Ny = g? ® 92? of g. (Here 92? might be zero.) Our main goal at this 
point is to determine the algebra S(ng)" of m-invariants in the symmetric al- 
gebra S(n4). It will turn out to be a polynomial algebra on one or two gener- 
ators (Theorem 4.6). The method will be to verify the hypotheses of $3 and 
then to apply the results of $3. 

Suppose that dim a= 1, is the unique simple restricted root, dim 
>1, k=R, @ is a Cartan involution of g in the sense that the Killing form 
of 9 is negative definite on € and positive definite on ), G is a connected 
Lie group corresponding to g, K is the connected Lie subgroup of G corre- 
sponding to £, and M is the centralizer of a in K. Then S(ny)" is the space 
S(n)™ of M-invariants in S(n4), and determining S(ng)™ amounts to proving 
a double transitivity theorem for the action of M on g? ® g2?, Specifically, 
let S, be the unit sphere in g?, and S, the unit sphere in 92? with respect 
to the bilinear form By, which is positive definite on g. The issue is to 
prove that M acts transitively on S, x S,. This theorem was proved by B. 
Kostant [6, $2.1] (in a somewhat different formulation) and independently by 
G. D. Mostow (oral communication; related ideas are discussed in [8, $19]). 
Kostant’s proof, as modified slightly by N. Wallach [11, Theorem 8.11.3], is 
purely algebraic. In order to show that this proof applies in our general set- 
ting, and for our later reference, we shall give an exposition of Kostant’s 
proof below. (Mostow’s proof is based on explicit case-by-case checking; 
only the case of the exceptional group F, is difficult.) We have been discus- 
sing the rather subtle situation in which dim 92? >1; if dim 97? <1, the ap- 
priate results are very easy. 

Return now to the general setting of §2. 

Fix ¢€%. We shall describe a canonical element py € $7(g%)". The 
symmetric bilinear form Bg is nonsingular on g® (see $2). Since Bg is €-in- 
variant and hence m™-invariant, and since g? is m-stable, the restriction of Bg 
to g? is m-invariant. As in $3, we get a nonzero homogeneous quadratic poly- 
nomial function x ++ B(x, x) on g?, and this defines a nonzero element tg € 
$2(( Bg induces a canonical m-module isomorphism (g%)* 3? 
which extends to an m-module and algebra isomorphism by: S(( g*)*) — 5( 9°), 
Let py = E4(ty), so that py 

Now we shall verify that the key assumption of the beginning of $3 holds 
in the present context, with M)=m acting on U = 3? by the adjoint action, 
and By, = Bg| g? x g?. The word “‘nonisotropic’”’ and the symbol e+ have the 
meanings of $3. 
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Lemma 4.1 (ef. [6, Thessen 2.1.7]). Let eo eg? bea Bg-nonisotropic 
vector. Then [m, e ol = . In particular, 3? =ke,® [m, eo). 


Proof. It is clearly sufficient to assume that k is algebraically closed. 
As in §2, we may choose a multiple ey of e9 such that Ble gy e4)=2/A¢, ¢). 
Setting hy = 2xg/(¢, 6) € @ and fy = —Oe4, we have the bracket relations 
eg] = 2e4, [hy, = 4 and ley, = hg (see $2), so that th gs 
e4» /4} spans a three-dimensional simple Lie subalgebra uy of g. Let 94 
be the uy-submodule _ gi? g. Since the eigenspaces of ad hy in 
Gy With eigenvalues 0 pte 2 are g° =m @®a and Q”, respectively, the repre- 
sentation theory of a three-dimensional simple Lie algebra implies that 
ley, m al = g?. But ley, m] es by Lemma 3.1, and since ley, a] = ke, 
we must have leg, m] = ey: The lemma is now clear. Q.E.D. 


Before applying Theorem 3.2, we shall derive two more results: 
Lemma 4.2, We have [g%, 9%] = 


Proof. We may assume that k is algebraically closed. As in $2 (or the 
last proof), we have the three-dimensional simple Lie 0G Ug of g 
spanned by hy, eg and /y. Let gy be the uy-submodule 1 all gi? of g. 
The eigenspaces of hy in 94 with eigenvalues 2 and 4 are 9? and ae 
respectively, and so the representation theory of u, implies that leg, g 9) = 
Q.E.D. 

The following consequence will be useful later: 


Corollary 4.3. Let X be a g-module and x € X an Mm-invariant vector an- 
nihilated by some Bg-nonisotropic vector € g?. Then (g? ® 92?) ~x=0, 
In particular, if dim @=1 and ¢ is the unique simple restricted root, then x 
is a conical vector in X. 


Proof. For all yé m, [y, eg)» x=y-+ (eg + (y+ x) =0, and so 
g? - x =0 by Lemma 4.1. Lemma 4.2 now implies that 92? +x =0. The last 
assertion is clear. Q.E.D. 


Theorem 3.2, Lemma 4.1 and the field extension technique imply: 


Theorem 4.4. If dim 9% = 1, then S(g?)" = S(g%). If dim > 2, then 
S( 9%)" is the polynomial algebra generated by by In particular, S( 9?" is a 
polynomial algebra on one generator. 


Corollary 4.5. Every m-invariant symmetric bilinear form on 9? is a 
scalar multiple of Bp. 


The corollary follows from either Theorem 4.4 or Corollary 3.8; see the 
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remark following Corollary 3.8 for a simple proof. We shall not have to use 
Corollary 4.5. 

Our next goal is to verify the hypothesis of Theorem 3.9 for U = g? and 
V= 92? in case 26€ & (see Lemma 4.7). This amounts to proving the Kos- 
tant-Mostow double transitivity theorem. For reasons mentioned above, we 
shall essentially repeat Kostant’s proof [6, $2.1], with a couple of modifica- 
tions (the proofs of Lemmas 4.18 and 4.20) taken from Wallach’s exposition 
[11, Theorem 8.11.3]. The result is: 


Theorem 4.6. Suppose and let nz be the subalgebra g? 23) 
of g. Then S(ny)" = g?)" S(g?%)", and this is a polynomial algebra. 
Moreover, let py € s* g?)™ be the canonical quadratic m-invariant defined by 
Bg, and if 2PEX, let pry € $?( 2)" be the same for 2. Then there are 
four possibilities: 

Case 1, dim g® =1 and g?* =0, Let x€ g®, x4 0. Then S(ny)" = 
S( 9%) = Rx], and kx] is the polynomial algebra generated by x. 

Case 2. dim g®>1 and g?* =0, Then and is 
the polynomial algebra generated by Py: 

Case 3. dim g® > dim = 1, Then S(g®*)"= apg] and S(g?%)" = 
S(g2%) = kyl, where ye g2?, y # 0. Both algebras are polynomial algebras 
in the indicated generators, so that S(n4)" is the polynomial algebra pgs yl 
in the two generators by and y. 

Case 4. dim > dim > 1. Then S(g*)" and S( 92%)" are the poly- 
nomial algebras and Kp. respectively, so that S(ng)" is the poly- 
nomial algebra Pog). 


Proof. We may, and do, assume that k is algebraically closed. The fact 
that dim g? > dim 92? will be proved in Lemna 4.8. Also, Cases 1 and 2 
are covered in Theorem 4.4. The rest of Theorem 4.6 follows immediately 
from Theorem 3.9, Lemma 4.1 and: 


Lemma 4.7. Suppose ¢, 26€%. Let e, € 3? and e,€ 92? be Bg-non- 


isotropic, and let m, be the centralizer of ey in m. Then [m,, e,] = ey in 

This result will follow from the next series of lemmas. Note that only 
Case 4 of Theorem 4.6 remains to be proved, since Lemma 4.7 is trivial if 
dim 92? = 1, But it will not be necessary in the following proof to impose 
any restriction on dim g??, and in fact the proof holds even if 97? =0. 

We shall use the notation of the proof of Lemma 4.1, so that e4 is a 
certain multiple of and spans a three-dimensional simple 
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subalgebra u, of g. Also as in the proof of Lemma 4.1, let 9g be the u,- 
submodule | a gi? of g. The natural representation of Ug on 9g decom- 
poses 94 into a direct sum of irreducible u,-submodules. Since the eigen- 
values of ad by on gy are among 0, +2 and +4 (with corresponding eigen- 
spaces 9° =m @a, gt and g*2), the dimensions of the irreducible com- 
ponents can only be 1, 3 and 5. A five-dimensional irreducible module occurs 
if and only if 92? # 0, and a three-dimensional irreducible module always 
occurs—Uy itself. Let g;C gg be the sum of all the (27 + 1)-dimensional 
irreducible ug-submodules of 94 (i=0, 1, 2), so that 84 = So ® 9, @9,. 
Also, let 9; 9 gi? (0<i<2,-2<j<2); then I; g? for each 


j=-i 


i=0,1,2. Also, g*?® = g#?, g*? = g*! @ g*! and g° = 9° 9° go. 
Lemma 4.8. We have dim g? > dim 92? 


Proof. This is clear since g? = gi @ gi, g2? = 93, dim g} = dim 9? and 
dim > 1 (since eg € Q.E.D. 


Lemma 4.9. The decomposition 94 = 9) ® 9; @ 9 is both Bg-orthogonal 
and B-orthogonal. 


Proof. First we shall show that Bg( 9s) = 0. Let x€ gi, ye Then 
y=[f4 2] for some z € = and so 


Bg(x, y) = —B(x, Oy) = -B(x, [-e,, @z]) = -B(Le 4, x], 6z) =0 


since leg, x] = 0. Hence B,(g15 9s) = 0, and similar arguments show that 
= Bgl gq, = 93) = 0 
and 
(gt, 95°) = B(gz!, g!) = 95) = Bl gg, 95) = 0 
95 9; » 9 So» 


Since B,(g?®, gt?) =0 unless j=k, and B(gi®, gt?) = 0 unless j=-k, 
all that remains is to show that Bg(g?, 99) = Bl 99) = 0. Let we 9°. 
Then v= w] for some w € 9}, so that 


By(u, v) = -B(u, 6v) = -Blu, [-e4, 
= -Blle 4, u), Ow) = ul, w) =0 


by the above, since ley, ul € 3} and Thus 99) = 0, Similarly, 
B(g%, g$)=0. Q.E.D. 


Lemma 4.10. Let e€ g? and and suppose Ble, {) = 0, or 
equivalently, Bg(f, 0e)=0 or Byle, Of) =0. Then [e, flem. 
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Proof. Since [e, f/]€ 9° = m @a and since m is the B-orthogonal com- 
plement of a in g®, it is sufficient to show that B([e, /], a) = 0. But if 
hea, then 


Bile, 4) = -Ble, = d(A)Ble, f) = 0, 


and so the lemma is proved. Q.E.D. 


Lemma 4.11. We have 99 Cm. 


Proof. Every element in 9 is of the form ley, /], where f € 95". Since 


€4 € 9), Lemma 4.9 implies that Bley, f) =0. But then ley, f) €m by Lem- 
ma 4.10. Q.E.D. 


Lemma 4.12. We have 9 = khy S (g? mm). 


Proof. It is to show Ckhg+m. But = les 97] 
and = fy, where is the Bg-orthogonal complement of 
in In fact, Bol fy) = Ble gs #0. Hence Chkhy + ley, 
and ley, 3] Cm by Lemma 4.10. Q.E.D. 


Lemma 4.13. We have 99 =Ker¢d nm). 


Proof. Since 9° = Qo is the centralizer of Uy in 9g, go is stable under 
0, and so 9° = Na) ® Am). But the centralizer of uy ‘n @ is clear- 
ly Ker ¢, and so 9° Na=Ker¢d Q.E.D. 

Let m,=9,Nm= g° Am (i=1, 2, 3), and note that my is the central- 
izer of ey in m and hence coincides with the subalgebra My in the state- 
ment of Lemma 4.7. The next lemma summarizes the last three: 


Lemma 4.14, We have 9° =m,, =kh,@®m, and 90 =Kerd@m,. In 
particular, M=M) Om, Om,, 


For all x€ 9, define x* = ley, x]. Write x** instead of (x*)*. Also, 
define x, = Ufgs x], and write x,, for (x,),. 

Recall the following standard fact about the representation theory of the 
three-dimensional simple Lie algebra uz: Let 7 be a finite-dimensional irre- 
ducible representation of Us, on the space V and let vé V be a nonzero 


eigenvector for (hy). Let p be the smallest nonnegative integer j such 


that i+1(,) = 0 and q the smallest nonnegative integer j such that 


4) =0. Then m(f4)a(e = (p+ 1)qv and = 
(q+ 1)pv. This implies: 


Lemma 4.15, For all x €m,, (x**), = 4x*, (x*), = 6x, (x,,)" = 4x, and 


(x,)* = 6x. 
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Lemma 4.16, Let x, ye m,. Then [x, = y] =(2/3)Ly*, 
Proof. By Lemma 4.15, 


[x, y**] = (1/O[(x*),, y**] = (1/0[(y*),, = (2/3)Ly*, 


Hence also 
[x**, y] =-Ly, x**] = -(2/3)[x*, y*] =(2/3)[y*, x*]. Q.E.D. 


Lemma 4.17. For all x, y€m,, [x, y]** =(2/3)[x*, y*I. 
Proof. We have 
[x, y]** =[x**, y] + 2[x*, y*] + Lx, =(2/3)Lx"*, 


by Lemma 4.16. Q.E.D. 
For all x € gy, let x; (i = 0, 1, 2) be the component of x in 9; with 
respect to the decomposition 94 = 99 ® 9; ® 92- 


Lemma 4.18. For all x, [x, = 0, 
Proof. By Lemma 4.17, [x, y]** = (2/3)[x*, y*], so that 
(Lx, yl**), = (2/3)1(x*),, + (2/3)Lx*, ] 


= 4[ x, + 4[x*, y] = x, 


using Lemma 4.15. But [x, = ([x, yl,)™*, and (([x, yl,)**), = 4([x, y],)* 
by Lemma 4.15. Hence [x, y]* = ([x, y],)*. But since [x, yl* = (Lx, y],)*+ 
([x, y]_)*, we get (Lx, y],)* =0, and so [x, y],=0. Q.E.D. 


Lemma 4.19, For all x, y€ m,, [[x, y**] =-2[lx, yl 
By 4.16, we have 
(Lx, y**] =, y],)™, yl = y]*™*, yl =x, 
(Lemmas 4.16 and 4.17) 
= [x, yl, -Lx, yl] 9], 
(Lemma 4.16) 


by Lemma 4.18. The lemma now follows. Q.E.D. 


* 
If x€m, note that x, and x,,= 0x. 


Lemma 4.20. Let x, y€m,, and suppose B,(x**, y*) =0. Then 
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Em, [x**, Vax! ty™*, and [x**, Yaw = 0, 


Proof. By Lemma 4.10 applied to g2? in place of g?, e=x** and f= 
Vax = Oy**, we have [x**, y,,lem. Thus 
[x**, ax**, Yeu = [ox**, Dy Lx = Xeeh 
proving the second assertion. 
To prove the last, first note that (yy 4)” = 4y,, by Lemma 4.15. Hence 


[x**, =[x**, (y,,)*] = 4x**, y,] 


= 4[x**, yl, -4[(x"*),, y] = yl, -16[x*, 
(again by Lemma 4.15) 
= -4([x, yl**), - 16x", 
by Lemmas 4.16 and 4.17. Thus 
([x**, a= 16[x*, yl 1° 
Hence by the second assertion, we also have 
([x**, Vex! = -<{{y™, = x], a= 16Lx, 
Thus 
(Lx**, )*=-8x*, yl + Lx, y*)), yl"), =-8lLx, ,)* = 0, 
by Lemma 4.18, It is finally clear that [x**, y,,],=0. Q.E.D. 
Lemma 4.21, Let x, y€ m,, and suppose By(x**, y**) = 0. Then 
=-Olx, 


Proof. We have [x,, y*"] = (1/4)[x,,, y**]}* by Lemma 4.15, and this is 
(1/4)[x**, y,,]* by Lemma 4.20. But [x**, y,,] €m (Lemma 4.20). Thus 
the last assertion of Lemma 4.20 shows that [x,, y*le 93. Now 


(by Lemma 4.15) 
-dx, yl** 
by Lemmas 4.16 and 4.17. But both itis y**] and [x, yl* are in 9) by the 


above and Lemma 4.18. Hence [x,, y**] =-@Lx, y]*, and the lemma follows 
by applying 6. Q.E.D. 


Lemma 4.22. Let x, y€m,, and suppose B,(x**, y**) ia 
y"*) =1/2(¢, $). Then 
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[[x, y],, = -x**/18, 


Proof. By Lemma 4.19, y]o, y**] =-2lx, y**].. But [x, = 
(1/6)(Lx, y],)*, by Lemmas 4.15 and 4.18, and so 


=—-(1/3)[Lx, ylys = (1/18)1Lx*, 
by Lemma 4.21. Also, 


Bg(y**, y**) = 1/2(g, $) = 2/(2¢, 24), 


and so as in $2 we must have the bracket relations for a three-dimensional 
simple Lie algebra, say u spanned by bogs 


Lh, 4s = 4 26,** and -6y**] = hog: 
But -Oy** =-y,, and Thus x” is an eigenvector for ad 
with eigenvalue 1, and must lie in a two-dimensional irreducible u,4-submod- 
ule of g. Hence applying the discussion preceding Lemma 4.15 to u,4, we 
get 

[y**, x*]] =x". 
Thus [[x, y],, y**] =-x**/18, and the lemma is proved. Q.E.D. 

In the notation of Lemma 4.7, a multiple e’ of the nonisotropic vector 
e,€ 92? may be chosen so that Be’, e') = 1/2(¢, $). Then e’ is of the 
form y* for some y€ ™,. Let Then e” =x** for some x € m,, 
and so by Lemma 4.22, [-18Lx, e'] =e". Thus there exists z€ such 


that [z, e,] =e". Lemma 4.7 is finally proved, and hence so is Theorem 4.6. 
Q.E.D. 


5. The structure of Ny. Continuing to work in the setting of $2, we shall 
transfer Theorem 4.6 to its ‘‘noncommutative analogue’’, i.e., to the structure 
theorem for Ny (see below). 

Retain the notation of $4. In particular, 6 €= is fixed. Recall the ca- 
nonical linear isomorphism A: S(g) G. oo Ny be the universal envelop- 
ing algebra of the Lie subalgebra ny = 3? ® 92% of g defined in Theorem 
4.6, so that A: S(ng) . Ng is an m-module isomorphism which restricts to a 
linear isomorphism from S(ng)" to Nb. We shall now use Theorem 4.6 to give 
an explicit description of the algebra NY. Recall the canonical quadratic 
M-invariants py and (if 26 <3) Pog € Define 


44 = 4) EN, 
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and similarly, if 26 €%, define 


Theorem 5.1. Ny is commutative and in fact is a polynomial algebra. 
More precisely, in the four cases of Theorem 4.6, we have: 

Case 1. ny = Ng = kx], the polynomial algebra generated by an arbi- 
trary nonzero x€ Q". 

Case 2. = the polynomial algebra generated by 

Case 3. Ny = Kay, yl, where y is an arbitrary nonzero element of 9? ¢, 
this is the dee algebra in the indicated generators. 

Case 4, ny = 94s 924), the polynomial algebra generated by q4 and 

Proof. Cases 1 and 2 follow immediately from the corresponding cases 
of Theorem 4.6, together with the fact that A: S(n4) =e Ng is an algebra iso- 
morphism since Ny is abelian. 

Since A(S(n4)" )= Ny, Theorem 4.6 shows that the elements q4 and y 
in Case 3 and G4 and 972% in Case 4 lie in Ny Also, since g2? is central 
in Ny, we see that ¢4 commutes with y in Case 3 and q,4 in Case 4. 

Denote the usual filtration of the enveloping algebra Jl, by CW, CH, Ces, 
so that Ny =k-+1 and =k+1@n4, and for each r ch, let 7, HM, 
be the vane map. (Here we take Nis = 0.) We also have he wed grad- 
ing S(n4) =o of S(ny). For each € Z,, let o,: 
N/M, be the canonical map, so that @, is a linear isomorphism by the 
Poincaré-Birkhoff-Witt theorem (see [2, Proposition 2.3.6]). 

Now suppose that we are in Case 3. We claim that gy and y are alge- 
braically independent. In fact, if not, then for some r € Z,, there is an equa- 
tion 


whose the a;,€ k, and some a. 0 (i=0,..., [r/2]); [-] denotes the 
“*greatest integer’’ function. Thus a. ell 
Consider the element 


[-/2] 
2 


] 2 r-2i ) 
a, y € Tig)e 


p-1» S° that 


| 
| =0, 
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O\s)=7 = r—2i 
r i=0 ai, (¢, y) 


a; 
i=0 


and so s=0. But this is a contradiction, since py and y are algebraically 
independent in S(n4), and the claim is established. A similar argument shows 
that in Case 4, g4 and 4,4 are algebraically independent. 

All that remains is to show that q4 and y generate Ny in Case 3 and 
that 74 and 4,4 generate Ny in Case 4, We shall carry out the argument 
only for Case 3; Case 4 is similar. Assume inductively that 9g and y gen- 
erate Ng a) n, where r € Z,. (This is trivially true for r= 0.) Now 


N= stag) 


for all € Z,. Let 


r+1 
=A (50 n sng) 


Then z is of the form 


r+1 
> a 
i=0 


(a,, €k) by Theorem 4.6. But 


r+1 [j/2] 


and so the induction hypothesis implies that z can be expressed as a poly- 
nomial in gy and y. This completes the proof of Theorem 5.1. Q.E.D. 


6. The case 2a ¢ &. In this section, we compute certain commutators 
in the universal enveloping algebra § of 9, and then we use these to deter- 
mine certain conical vectors in the twisted induced g-modules X”, where 
v €a* (see $2). Specifically, we prove our main results (Theorems 10.1 and 
10.2) in the special case in which twice the relevant restricted root is not a 
restricted root (see Theorems 6.17 and 6.18). But the first part of the sec- 
tion, through Lemma 6.4, is valid in general, and this will be important in §8. 
Maintain the hypotheses and notation of the last section. For conven- 
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ience assume for awhile (through Corollary 6.10) that k is algebraically 
closed. 

Continue to fix ¢ € 2, and choose bg, &gs fy, and uy as in $2. Apply- 
ing the constructions of the beginnings of $$4 and 5 to -¢ in place of 4, we 
have canonical elements € $7(g-?)" and = 2Np_y)/(d, 
Our goal now is to compute the commutator ley, q_¢l in S. 

Since Bley, ey) = 2/(d, it is clear that Bol fy, = 2(¢, ) also. 
Using the notation of the proof of Lemma 4.7, we recall from Lemma 4.9 that 
the decomposition 94 = 9) ® 9; ® 9, is Bg-orthogonal, and hence so is the 
decomposition = Set = /y- Since Bg is nonsingular on 
g-? and k is algebraically closed, we may complete /, to a Bg-orthogonal 
basis {/,,..., of such that B,(/;, /;) = 2/(¢, ) for all i=1,..., 
n. But since € we may also assume that /,,..., /, € and that 
€ Here dim g? = dim g~? and r= dim Note that 
dim 97° = dim 95! =n-—r, and hence that 92? # O if and only if r<n. 

The canonical element p_¥y € s( g~?) is equal to the sum of the squares 
of the elements of any B,-orthonormal basis of g~?, and so 


To compute [e ¢ 7. gs we first note that 


=1 


n 


= (leg, + 2/;leg, 


i=1 


= + 2f Le gs {,)). 


Lemma 6.1. [/,, [/,, egll = -2/,. 


Proof. This follows immediately from the bracket relations for hy, eg 
and Q.E.D. 


Lemma 6.2. For al] i=2,..., 2, leg, € 


(4, 4) 2 

1-9" 
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Proof. Apply Lemma 4.10. Q.E.D. 

Lemma 6.3. For all i=2,...,1 Uf; f;» e gl =2/,, and forall i=r+ 
1, egll = 6/;. 

Proof. Let i=2,..., ” Then 


Legs [js eglll = Legs Legs =A,» Legs Legs 
But leg, f;) €m (Lemma 6.2), so that 


ley, = ley, = df, ley, Il. 


Now we can apply the standard representation theory of the three-dimensional 
simple Lie algebra u,. If 2 <i<r, then € and so leg, =2/;, 
and if r+1<i<n, then € and so Uf,» ley, = 6f;. Hence 

legs ley, =-20/, or -60/;, respectively, and so 


ley, e gill = 2lf;» or 6/1, 
respectively. But [/;, 0/,]=-Bg(/;, /;)x_g (see §2), and this is just hy. 
Thus 

leg, = 2hy or 6h, 


respectively. But [/;, [/;, eg] € g~?, and so has eigenvalue -2 for ad hy. 
Since leg, Uf; Uf» ell] is a multiple of hg; the representation theory of 
uy implies that Uf; Uf,» must be a multiple of /,. Since ley, {= hg; 
the multiple is determined and the lemma follows. Q.E.D. 

In view of these lemmas, we have 


Legs gg) = + Df, + Af, +2 flew 


+ > {legs id). 
i=2 


(1) Pg = Al(dim + (dim g?*)(2¢)) € a*. 


Then py = 4(n + = 4(3n 27g, and so pylhy) = 3n—2r. The 
conclusion is: 


Lemma 6.4. Define Py as in (1). Then 


Tes, q_¢) = + + {legs e 
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We could now use the derivation law to write down an expression for 
leg, 4 4), for all de Z,. be order to simplify matters, we shall 
assume at this point that g2? = 0, which implies that g~? is an abelian Lie 
subalgebra of g. The much subtler general situation is deferred to subse- 
quent sections. 


Lemma 6.5. Suppose 26 ¢ &. For all deZ,, 


ley, 4] = (1% + (pg - dd) + > filegs 
Proof. From Lemmas 6.4 and 6.2 and the commutativity of 97%, we get 
= (4 ~ fg + f,leg, i) 


But 7_4 is clearly a restricted weight vector for the action of @ on ¢ with 
restricted weight -2¢, and so 


=-Aj- + = 1) + hg). 


Hence 


1) + hg) = - - 1)), 


and so 
+ ghy - 1) 


= -2-2(d-1) + legs f; ) 


( + (py - dd) (hy) + > {legs i3) -Q.E.D. 
i=2 
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The following result is now immediate: 


Corollary 6.6. Suppose P€X, and 26¢ Xd. Let X be a g-module and 
x €X aconical restricted weight vector with restricted weight p € a*. Then 


for all deZ,, 


eg 4+ 4) =2d((n+ pg - 


If dim g? = 1 (in which case gt2? = 0 automatically), we also have the 
following lemma and corollary: 


Lemma 6.7. Suppose dim g? = 1. Then forall deZ,, 


ley, = + (py - db/2) (hg). 


Proof. Since leg, fg) = hg, we have 


ley, ($1 = fi. 


(571 + = 1S - + by), 
so that 
ley, (£1 = - d(d-1)) = + (py 
since Pglhg) Q.E.D. 
Corollary 6.8. Suppose 6€ 2, and dim g? =1. Let X be a 9-module 


and x €X an teinvariant restricted weight vector with restricted weight p € a. 
Then for all de Z,, 


eg x) = + py x. 


Corollaries 6.6 and 6.8 imply the following two results. These have the 
benefit of being true even if k is not algebraically closed, as the field exten- 
sion technique shows; we also use the fact that the Bg-nonisotropic vectors 


in span g?. 


Corollary 6.9. Suppose PEL, and 26¢%,. Let X be a g-module and 
x €X a conical restricted weight vector with restricted weight a*. Then 


for all e, eg? and de Z,, 
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x) =-2d((u + pg — dd) 


Corollary 6.10. Suppose 6€ 2, and dim 3? =1, Let X be a g-module 
and x €X an n-invariant restricted weight vector with restricted weight p € a. 


Then for all e, € g® and deZ,, 


Assume for the rest of this section that k is an arbitrary field of charac- 
teristic zero—not necessarily algebraically closed. We are now ready to prove 
the following basic result: 


Lemma 6.11. Suppose and 26 Let ve and let Xo be 
the canonical generator of the twisted induced g-module X” = V”~ (see $2). 
Set Y= Ny x (see $5 for the definitions of Ng and and de- 
fine hi, €a tobe hy if dim and 2hy if dim g® = 1. If (v-p+pgh}) 
is not a positive even integer, then Y is the span of x. Suppose 
(v-p +p) (by) = 21, 1 @ positive integer. Then Y is two-dimensional, with 
basis ix, fi. Xo}, where f=q_4 if dim 3? > 1 and f{ is a nonzero element 
of if dim g? = 1, In this case, Xq is a restricted weight vector in 


X” with restricted weight s4(v-p+p4)—pg (recall from §2 that Sy is the 
Weyl reflection with respect to ¢). 


Proof. Since the map w: JiI- +X” which takes y €JI~ to y+ Xo is an 
m-module isomorphism (see §2), we see that 


° x)" = (o(N_ = ° Xo- 


But by Theorem 5.1 (Cases 1 and 2), ns is the polynomial algebra &l/], 
where / is as in the statement of the lemma. Hence 


xo) = Hf] Xo- 


Let we so that a (a,€k, and only finitely many a, # 0), 
and let e, be a Bgnonisotropic vector in 9°; if dim g? =1, take e, = Of. 
Suppose dim 3? > 1. Then by Corollary 6.9, 


+ (u+ x.) =-2 a ,d((v p + pg dd) (hg) (Be 


0 


and this expression is zero if and only if ajd((v + py — dd) (hg)) = 0 for 
all d. But this is the case if and only if a, =0 for all d>0O such that 
(v-p + py) (hg) # 2d. The lemma for dim > 1 now follows from Corollary 
4.3; the last assertion of the lemma is clear since q' 4 * ¥9 has restricted 
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weight v — p — 2/¢, and 


solv —p+py) + Py - 21h. 


The case dim g? =1 is similar, using Corollary 6.10. Q.E.D. 

Remark. Note that Lemma 6,11 holds when ¢ is not necessarily a sim- 
ple restricted root, and even when 4¢@ is a restricted root. 

The situation in Lemma 6.11 simplifies nicely when dim a= 1; the next 
result is an immediate consequence of the lemma: 


Theorem 6.12. Suppose dim a=1 and PE, is the only positive root. 
Let véa*. Then the conical space Y of the twisted induced g-module X” 
is either one- or two-dimensional. Define hy € a to be hy if dim 9? > 1 and 
2hy if dim 9? =1, and let x. be the canonical generator of X”. If hy) is 
not a positive even integer, then Y is the span of x. Suppose v(b4) = 2/, 
l a positive integer. Then dim Y =2, and Y has basis {x,, fi. xo}, where 
f= q_¢ if dim g? >1 and { is a nonzero element of g~? if dim 9? =1, 
In this case, f' x9 is a restricted weight vector in X” with restricted 
weight S4v — p. 


Lemma 6.11 also gives some interesting information about the conical 


space of X” even when dim a is arbitrary. To see this, we need some gen- 
eral facts. 


Lemma 6.13, Let I1C 2, be the set of simple restricted roots. Then the 
subalgebra n of g is generated by the subspaces 9° as @ ranges through 


Il. 


Proof. We may, and do, assume that k is algebraically closed. For all 
define the order ol) of to be the integer n, (ae Tl), where the 
integers m, are defined by the condition W == n,a(aell). Then We, if 
and only if ol) >0, and WelTl if and only if of) = 1. We shall show by 
induction on ow) (we,) that g” lies in the space generated by the 9” 
(aell). This is clearly true if of) = 1, so assume it is true for o(y) = m 
(m> 1), and let w’ €X, have order m+ 1. Then the standard theory of root 
systems shows that there exists @ € II such that the scalar product (y’, a) 
>0, and hence @ is a positive restricted root of order m. Define 
the subspace V of g by V= renee gv tna. and construct as in $2 (taking 
a for }) a subalgebra u, of g spanned by h,, e, and /,. Then V isa u,- 
submodule of g, and ad h, has eigenvalue ¥(h,) + 2n on the subspace 
of V; in particular, is exactly the + 2n)-eigenspace for 
ad h, in V. But 
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+2=(W+ a)(h,) = >0, 


and so the integer ¥(h,) >-1. Hence ad h, has eigenvalue >-1 on 3”, and 
so by the representation theory of the three-dimensional simple Lie algebra 
u,, we see that [e,, = = and so [g*, = In view of 
the induction hypothesis, we are finished. Q.E.D. 


Remark. The above proof is of course similar to the proof of Lemma 4.2. 


Lemma 6.14, Let a (see Lemma 6.13). Then s,p-p=SoPq -Pas 
and plh,) =p,(h,). 


Proof. The first assertion is proved in [7(b), Lemma 4.16]. It follows that 


Pa =SalP Pa) =(p—pq) pa) (hq), 
and so (p-p,)(h,)=0. Q.E.D. 


Lemma 6.15. Jl- is a direct sum of restricted weight spaces (with res 
spect to the natural action of a on Y) with restricted weights consisting of 
those elements of a” of the form -> ngB, where B ranges through Il and 
ngé Z,. Let aell, and suppose yeNl~ is a restricted weight vector with 
restricted weight of the form ca(cék). Then y eM, and cé-Z,. 


Proof. Let Then = Iin_, as ranges 
through zi. Let be the elements of Then the multi- 
plication map in § induces a linear isomorphism 


The lemma now follows easily. Q.E.D. 


Lemma 6.16. Let aell, ve a* and Xq the canonical generator of the 
twisted induced module X”, The sum of the restricted weight spaces of X” 
with restricted weights of the form v-p + ca (cé€ k) is exactly x * Xo. 


Proof. This is clear from Lemma 6.15 and the fact that the linear isomor- 
phism w: Jim — X” which takes y to y+ Xq raises restricted weights by 
v—p; i.e., if y€JI~ is a restricted weight vector with restricted weight 
pea, then w(y) is a restricted weight vector with restricted weight v —p 
+p. Q.E.D. 


We now have the following generalization of Theorem 6.12: 


Theorem 6.17. Let a be a simple restricted root, and suppose 2a ¢ &. 
Let v € a”, and let Y be the subspace of the twisted induced g-module X” 


spanned by the conical restricted weight vectors with restricted weights of 
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the form v-p+ca(ceék). Then Y is either one- or two-dimensional. Define 
hi,€ @ to be hy if dim g* >1 and 2h, if dim g* =1, and let X9 be the ca- 
nonical generator of X”. If Ah’) is not a positive even integer, then Y is 
the span of xo. Suppose v(h',) = 21, | a positive integer. Then dim Y =2, 
and Y has basis fi. Xo}, where {= if dim >1 and is a non- 
zero element of g~° if dim 9*= 1. In this case, ['- Xq is a restricted weight 
vector in X” with restricted weight s,v —p. 


Proof. Since the conical space of X” is clearly astable and hence the 


direct sum of its intersections with the restricted weight spaces of X”, Y = 
Xo) 


+ Xo by Lemma 6.16. Let _, so that Xp, 
where uw €Jl_,. Let B be a simple restricted root not equal to @. Then 

B — @ is not a restricted root and is not zero, so that [94, n_J= [94 9-4 
= 0. Hence [94, ul =0 in G, and so 


-(u- x) 


Lemma 6.13 now shows that y€ Y. Thus Y = a... . x) 


rem now follows from Lemmas 6.11 and 6.14. Q.E.D. 

Remark. In the notation of Theorem 6.17, the assertion that v(h{,) be a 
nonnegative even integer (possibly zero) is equivalent to the existence in X” 
of an m-invariant restricted weight vector with restricted weight s,v-p= 
v-p—v(h,)a (use Lemma 6.16). In this case, the m-invariant restricted 
weight vectors with restricted weight s,v—p span a one-dimensional space 
and are conical vectors. Note also that if v € a” is arbitrary and if f and 
X 9 are defined as in Theorem 6.17, then /” + 9 (ma positive integer) is n- 
invariant if and only if its restricted weight is s,v —p. 


and the theo- 


We can reformulate our conclusions as follows: 


Theorem 6.18. Let a be a simple restricted root such that 2a ¢ X. Let 
€ a", and suppose that is of the form ca (c€k). (If dim a =1, 
then this is automatic.) Then Hom,(X*, X”) is at most one-dimensional, 
and dim Hom,(X", X”) =1 if and only if either p=v, or else p=s,v and 
v(h‘,) is a nonnegative even integer, where if dim 9° >1 and 
2h, if dim g* = 1. Also, dim Hom,(x”, X”) =1 if and only if X* is isomor- 
phic to a g-submodule of X”. 


Proof. Recall from$2 that Hom,(X", X”) is isomorphic to the intersec- 
tion Z of the conical space of X” with the restricted weight space for u—p. 
If then clearly dim Z = 1. Suppose p= s,v and v(hi,) is a nonnega- 
tive even integer. Then the above remark implies that dim Z = 1. Converse- 


ly, suppose Z # 0, so that X” contains a conical restricted weight vector x 
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with restricted weight -p. Since p=v+ca,p-p=v—p+ca, andso 
x€Y, in the notation of Theorem 6.17. If  # v, then x is not a multiple of 
9 (again in the notation of Theorem 6.17), so that v(h’,) is a positive even 
integer and p-p=S,v—p, i.e., by Theorem 6.17. The last asser- 
tion of the theorem follows from the fact that any nonzero 9-module map from 
X" into X” is injective (see $2). Q.E.D. 


7. The fundamental commutation relation in N_y. We shall continue to 
use the notation of $6, with k algebraically closed. But in this section, we 
explicitly assume that 9?° ¥ 0, i.e., that 26 € =. We have the canonical 
elements € 2%)" and q_54= (see $5). 

It is clearly important to compute the commutator ley, q_> $l in §. This 
will easily turn out to be essentially Uf gs q_gls and we have to know to what 
extent this element commutes with q_ 4. In particular, we want to compute 


[[f4s 9_ gl, 9_g]- Lemma 6.4 also points out the importance of this commu- 
tator, since we need it in principle to simplify the commutator leg, q? gl It 


will turn out that (fy, q_ gs q_¢l is essentially 149-24» and this is what 
we call the fundamental commutation relation in N_y, the main result of this 
section. Because of this, we know how to compute the further commutators 
[-- “Ulf q_ gis The abstract algebraic setting in the next 
section will reveal a more precise reason for calling our relation ‘‘fundamen- 
tal’’. The point will be that the fundamental relation and the trivial relation 


149-2¢ = are in a sense all the relations involving and 
91_2¢° 
Lemma 7.1. The map ad fy: 95! oo 95? is an isometry from 4B,| 95" x 
to Bg|g>” x 95”. 
Proof. Let x, y € q,’. Then 
Bollfy, x], Ufgs yl) = fy, xl, Of 4, yl) gs xl, ley, 
= -Biley, Uys Oy) = —4 B(x, Oy) 


(by Lemma 4.15) 
= 4B fx, y). Q.E.D. 


Recall from $6 the B g-orthogonal basis ify, of 


Lemma 7.2. We have 


Proof. By Lemma 7.1, gs [fg is a Bg-orthogonal 
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basis of = 2? such that each Bo (Lf Uf 4s {,) = 8/(¢, d). Since 
q_>¢ is 1/2(d, d) times the sum of the squares of the elements of any By- 
orthonormal basis of g7 2%, we must have q_ 44 =(1/16) iF. But 
=0 if j=1,...,7 and so the lemma follows. Q.E.D. 


Lemma 7.3. We have 4 


1 n 


n 


Proof. By Lemma 7.2, 
1 > 


1 n 


1 


(by Lemma 4.15) 


n 


1 
== 
2 li 
(since € 29, which is central in 
1 n 
=> 
2 
On the other hand, q_4 = , so that 


n 


Q.E.D. 


Theorem 7.4. (The fundamental commutation relation in N_ 4g.) We have 


=-S4/49_24- 


1 i 
I n 
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More generally, suppose the field k is arbitrary of characteristic zero, and 
let fé€ Then 


=-64/4_24- 


Proof. It is clearly sufficient to prove the first assertion. But by Lem- 
ma 7.3, 


q_gls q_¢) = 4{le,, q_¢l 


by Lemma 6.4, and this is just -64/49_,4. Q.E.D. 


8. The transfer principles. Here we assume that 92? # 0, as in $7, 
But we take k to be an arbitrary field of characteristic zero. 

If we attempt to compute directly the conical vectors in the twisted in- 
duced modules X” (v € a*), we are confronted with monumental difficulties 
(cf. the remark at the end of this section). Trying to avoid these problems, 
we discovered a metamathematical “‘transfer principle’? (Theorem 8.6) which 
enables us essentially to transfer certain theorems about conical vectors in 
modules over one semisimple symmetric Lie algebra to theorems about coni- 
cal vectors in modules over any other semisimple symmetric Lie algebra. 
This reduces the problem of computing certain conical vectors to any one 
special case of semisimple symmetric Lie algebra (in which twice the rele- 
vant simple restricted root is a restricted root). The proof of this “‘transfer 
principle for conical vectors’’ is based on another metamathematical result 
(Theorem 8.4) which states that certain kinds of algebraic identities in Ng 
can be transferred from one semisimple symmetric Lie algebra to another. 
The starting point for the proof of this theorem is the ‘‘fundamental commu- 
tation relation’’ of the last section. 

Let P=kw, x, y, z], the polynomial algebra in four indeterminates, 
and define a P-module structure on Nig by the correspondences 


w + left multiplication by 
x + left multiplication by 9_2¢) 
y + right multiplication by 7_4, 


z ++ right multiplication by 7_>¢- 


This P-module structure is well defined because [q_¢, q_2¢! = 0 in 


Theorem 8.1. Let { be an arbitrary Bg-nonisotropic element of g~?, 
and let P! denote the annihilator of { in P under the above module action. 
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Then the ideal P! is generated by x -z and w? —2wy + y? + 64x, that is, 
Pf = P(x —z) + P(w? — 2wy + y? + 64x). 


Proof. Since 9_2¢ is central in Ng, it is clear that x - ze P/, and 
so P(x —z)C P/, The fundamental commutation relation, Theorem 7.4, im- 
plies immediately that w? — 2wy + y? + 64x € P/, and hence the ideal gener- 
ated by this element is contained in P/, What we must show now is that these 
two ideals generate P/, 

Let ae P/, a# 0, and regard P as Ax, y, z][w]. Since the leading co- 
efficient 1 of w? - 2wy + y? + 64x is a unit in Alx, y, zl], the Euclidean al- 
gorithm implies the existence of s, t€ klx, y, z][w], where ¢ is a polynomial 
of degree at most 1 in w, such that 


a= s(w? — 2wy + y? + 64x) +12. 
Here ¢ is of the form u+ wv, where u, v€ kx, y, z]. Since ae Pt Pl, 
Also, there exist polynomials u’, v' € ky, z] such that 
u=u' (mod P(x—z)) and vev’ (mod P(x -2z)). 
Hence 


t=u'+wv' (mod P(x -2)), 


and so 
a=u'+wv' (mod P(x -z) + P(w* 2wy + y? + 64x). 


In particular, uv’ + wv’ € P/, Write u' = u'(y, z) and v' = v'(y, z). Then by 
the definition of the medule action of P on Ng; we have 


and so 
flu'(q_ 9-4) + q_glv (9_ 4» 9224) = 


Set aly, z) =u'(y, z) + yu'(y, z) and Bly, z) =-v'(y, z) (a, B € ky, z)). 
Then 


4, Lf, q_2¢) = 0, 


It is sufficient to show that a = 8 =0, since then we will have u=v= 0, 
and so a€ P(x — z) + Pw? — 2wy + y? + 64x). 

As in the proof of Theorem 5.1, let Ny ¢ N, Cc I, C +++ be the usual fil- 
tration of N_g, and for each r € Z,, let mI =e nA be the canonical 
map. (Here = 0.) Also, let S7(n_ 4) n/N,_, be the natural map, 
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so that 0, is a linear isomorphism by the Poincaré-Birkhoff-Witt theorem. 
Write 


By, = by 
j7=0 
with c, de Z, and Gin bj Ek If a # 0, we may assume that some a;_ # 0 
(i=0,...,c), and if B 4 0, we may also assume that some b.,# 0 
(i=0,...,¢). Also, if a=0, take c=0 and if B=0, take d=0. 

Now we claim that [/, q_ 4) el, and [f, q_¢! ¢ I. In fact, it is suffi- 
cient to prove this when & is algebraically closed. But then a suitable mul- 
tiple of f may be taken as the l¢ of §7, and the claim follows from Lemma 
7.3. In particular, fa(q_4, and [f, € 
ee recall that the sum of these two terms is zero. Either 2c +1>2d+2 
or 2c + 1 < 2d+ 2. Suppose the first inequality holds. Then 


9_29)) = 9, 
so that 
c 


i=0 


Then 


i=0 


c 
= T5041 = 0. 
i= 


Hence s = 0, and so each a, =0 (i=0,...,c). This is only possible if 
a=0. But then c =0, and the inequality 2c +1>2d+2 cannot hold. Hence 
we may assume that 2c + 1 < 2d+ 2. In this case, 


ay z2=> > a, 

j=0 i=0 

and 

Let 
and set 
| 
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d 
d- 2 
75442 (i q bath oats) = 0. 
i= 


Since [f, q_ (see above), there exists a nonzero element g€ S%n_y) 
such that A(g) =[f, (mod N,). Set 


h= b. Ap’ € S24*2(n_ 4) 


Then 


d 
24426) = = 7244 (ve 


d 
d-i 


Hence h=0. But g¥# 0, so that each b6,,=0 (i=0,..., d). This proves that 
B=0, and so d=0. Since 2c +1<2d+2, we also have c=0. Thus © is 
a scalar, and the equation fa = 0 shows that 2 =0. We have proved that 
a= =0, and hence the theorem. Q.E.D. 

Suppose now that dim 92? = 1, and suppose there exists an element 
such that = in (Such an element exists if k 
is algebraically closed, but otherwise, it might not exist.) Define a new P- 
module structure on Nig by the correspondences 


w + left multiplication by q_¢» 
x +» left multiplication by r_>4, 
y + right multiplication by q_ 4, 
z + right multiplication by r_, $° 
This P-module structure is well defined since lq_4, r_og! =0 in N_ 4g. 


Theorem 8.2, Under the above hypotheses, let f € g-? be Bg-noniso- 


tropic, and let Py be the annihilator of { in P under the new module action. 
Then 


P(x — z) + P(w? 2wy + y? + 64x), 


Proof. The first part of the proof of Theorem 8.1 carries over to the pre- 
sent situation and shows that is sufficient to prove the following: Let 
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and so 
| 
= 79442 =) = 0. 
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aly, z), Bly, z) ekLy, zl, and suppose 
Then a = B=0. 


It is clearly sufficient to assume that k is algebraically closed and that 
{ is the element /4 of $$6 and 7. But then by Lemma 7.3, [fg> 9_gl = 
2 Ags /,) (where /, is as in that lemma; see $6), since dim 92? =1,. By 
Lemma 7.2, = 16q_54 in N_g, and since € 2? we must 
have 4r_44= tf 4, J. Changing the sign of /, if necessary, we may as- 
sume that 4r_,4=[/4, Setting a'(y, z) = aly, z) and B'(y, z) = 
8zB(y, z) in kly, zl, we have 


(2) _ 72g) + 724) = 9, 


and it is sufficient to show that a’ = B’ = 0. 
Now leg, /,) €m (where eg is as in $6), by Lemma 6.2, and so 


Legs fal gs 72g) =Legs 724) = 0 


in N_g, since 4. Also, [le,, fg) =-6/,, by Lemma 
4.15 and = 6/4 by Lemma 6.3. Hence the application of 
to (*) gives 


Abbreviate a'(q_ 4, 7_24) by % and B(q_4, by Bo. Multiply- 
ing (2) on the right by po, multiplying (3) on the right by -8y, and adding 
the two results, we get {shag + B?) = 0. Since g has no zero divisors, 


(a9 + (a (-1)'/7B,) = + = 0, 


and so a, = +(-1) 1/28... Thus (+) implies that a) = 8, =0. The fact that 
a‘(y, z) = B'(y, z) = 0 now follows from Theorem 5.1, Case 3. Q.E.D. 

Now assume the original hypotheses of this section, so that 92? # 0. 
The following consequence of the last two theorems is immediate: 


Corollary 8.3. Let Q be the polynomial algebra in two variables over k, 


and let a,,b,€Q (i=1,...,7,7€ Z,). Let { be a Bg-nonisotropic element 
of Then 


(4) 9-24) = 9 
i=l 


in Ng if and only if 
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4; 0b, P(x - z)+ P(w? — 2wy + y? + 64x), 


i=1 


where we identify P with Q ®Q inthe natural way. Suppose in addition 
that dim g2? = 1 and that there exists an element r_,44 € g-2¢ such that 


= Then 


(5) > alq_ gs r_ r_o¢) =0 


i=l 


in Nig if and only if 


> a, @b, € P(x — z) + P(w? - 2wy + y? + 64x?), 


i=l 


where we again identify P with Q@Q. 
This corollary proves: 


Theorem 8.4. (The transfer principle for N_y.) Let Q be the polynomial 
algebra in two variables over k, and let a,, b;€Q (i=1,...,7, 7€Z,). Let 
(g, 6) be a semisimple symmetric Lie algebra over k with symmeiric decom- 
position g= a a splitting Cartan subspace of C the corre- 
sponding system of restricted roots, =X such that 2p€X, the univer- 
sal enveloping algebra of the Lie subalgebra n_4 = g-? @g~2? of g,A: 
S(n_ 4) —_ Ny the canonical linear isomorphism, B the Killing form of 9, 
Bg the symmetric bilinear form on 9 defined by the condition Bg(x, y) = 
-B(x, Oy) for all x, y € 9, { @ Bg-nonisotropic vector in Pig € 
and € 2) the canonical elements defined by Bg, and q_4 = 
and $) eN_y. Then the truth or fal- 
sity of equation (4) in Ns depends only on a; and b; (i=1,...,7) and 
not on 9, 9, a, or f. Moreover, suppose in addition that dim = 1 and 
that there exists an element r_,4 € such that =4_>¢: Then the 
truth or falsity of equation (5) in Ns depends only on a, and b; (i=1, 

1”, and not on 9,0, a, or 


In order to apply this theorem to conical vectors, we need: 


Lemma 8.5. Suppose ¢ and 26€%,, and let V be a g-module, v € 
V * arestricted weight vector with restricted weight p € a", Cy € g? and 
i, Then 


where Vij eNl_y is given by the formula 
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gi 
Vij = 4! o? 7-6'9_249-¢ 
m=1 


where py is as in Lemma 6.4, Moreover, suppose in addition that dim ge 
= 1 and that there exists an element € g-2? such that = 
Then 


where Vij € Ng is given by the formula 


3 


i 
+ py) (hg) +2 - 4m)r (6e,)q™3). 


Proof. We may assume that k is algebraically closed and that e, = C4, 


so that Je, =-/4. To prove the first assertion, note that 


j 


m=1 
By Lemna 7.3, the first term on the right is %4 jl/y, 9_gl’y¢qi.g°v To 


handle the second term, use Lemma 6.4. Since v € V", Lemma 6.2 shows that 
the second term is 


But it was shown in the proof of Lemma 6.5 that hgamg = q7G (hy — Am — 1)). 
Thus the term becomes 


i 
2((u + Py) (hg) +2- 4m)q) 
m= 


and this proves the first assertion of the lemma. 
Now suppose that dim = 1 and that =4_2¢ (r_og € 2%), 
Then 
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P 


The second term is treated exactly as in the first part of the proof, and all 
that remains is to show that the first term is (1/8)j[/y, q_ get ov. 
But Uf, q_ 2f and = as in the proof of Theo- 


rem 8.2, and so 


= 


ley, r_ogl = leg, = 


by Lemma 4.15. Thus the two indicated terms are equal, and the lemma is 
proved. Q.E.D. 


We can now prove: 


Theorem 8.6. (The transfer principle for conical vectors.) Let Q be the 
polynomial algebra in two variables over k, and let a,€Q. Also, let cy €k. 
In continuation of the notation of Theorem 8.4, let X, be a positive system 
in &, 2€2%, a simple restricted root such that 2a €%, h, € a as defined in 
$2, v € a* such that v(h,) = Cop X” the twisted induced 9-module (see $2) 
and x. € X” the canonical generator. Then the truth or falsity of the asser- 
tion is a conical vector in depends only on a, 
and Cy, and not on g, 0, a, %4, a or v (except that v(h,) = cy). Moreover, 
suppose in addition that dim 9?* =1 and that there exists an element por 
€ g~?% such that r* 2a = %n29° Then the truth or falsity of the assertion 
a? * is a conical vector in X”" depends only on ay and co, 
and not on 9, 9, a, a, Tio, (where v(h,) =c 


Proof. Write Q = kl x, y] and ao b; ty) (t€Z, and b;, € k) 
and assume # 0. In view of Theorem 5. 3 and 4), a 
Xo is a nonzero M-invariant vector in xX”. Let €, be a Bg-nonisotropic vec- 
tor in 9°. Then by Corollary 4.3 and Lemma 6.13 (see the proof of Theorem 
6.17), €9 + os 9229) * Xo) = 0 if and only if 9_2,) * is con- 
ical. But by Lemma 8.5, this is the case if and only if 


(6) in N_, 


i,j=0 
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where Vij eN_, is as in Lemma 8.5, with @ replaced by @ and pp by v-p 
(p g”)y, Wed,). But (v-p +p,)(h,) = v(h,) = Co by Lemma 
6.14, so that 


i ; 


i 
m= 


Since 9e, is a Bg-nonisotropic vector in g~%, (6) is an equation of the form 
treated in Theorem 8.4, with @ replaced by ©, and with the a; and b; in 
Theorem 8.4 dependent only on a) and cy. That theorem now implies the 
first assertion of the present one. 

2 2 - 

Now assume that dim g**=1 and that r2,,=q4_,, (r_,, € 97%), and 
let a) # 0 and e, be as above. By Case 3 of Theorem 5.1, ao(q_.57_>,)° 
Xo is a nonzero m-invariant vector in X”. Also, since 7_»q is a nonzero ele- 
ment of (a.(q_.> * X9) =0 if and only if 


(alq_ * Xo) =0 


and this is true if and only if alq_.s P20) * X9 is conical, as above. Com- 
bining the last parts of Lemma 8.5 and Theorem 8.4 as above, we get the last 
assertion of the theorem. Q.E.D. 

Remark. Of course, the above proof in principle provides an explicit re- 
formulation of the assertion is a conical vector in 
in terms of 4) and Cy alone, and similarly for ajq_a> vo.) * Xo, under the 
extra hypotheses. But these reformulations are much too complicated to be 
useful in determining directly the conical vectors in the induced modules X”. 
Instead, we shall compute the conical vectors for a special g (see $9), and 
then use Theorem 8.6 to obtain them for general g. The determination of the 


conical vectors in the special case is not trivial, but at least it can be done. 


9. A special case. Following the plan indicated by Theorem 8.6, we 
shall determine all the conical vectors in all the twisted induced modules X” 
(v € a*) for a special semisimple symmetric Lie algebra (g, 0). Here (g, 4) 
will have essentially the same structure as the real semisimple Lie algebra 
8u(2, 1). Our methods will be special; in fact, one of our main points is that 
it is too difficult to compute directly the conical vectors in general (cf. $8). 
We are grateful to L. Corwin and N. Wallach for their help in carrying out this 
special case (see the introduction). 

Assume k is algebraically closed. Let g= &(3, k), the simple Lie al- 
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gebra of alltraceless 3 x 3 matrices over k. Let i=(-1)!/?, and let EC g 
and )C g be the spaces of matrices 


| 


respectively, where a;,,b;; €k and 2a,,+4@,,=0. Then g= (ft, €] 
c and C €, so that the linear automorphism of g 
which is l on € and -1 on } is a Lie algebra automorphism. Thus (g, 9) 
is a semisimple symmetric Lie algebra with symmetric decomposition g= 
@ 

For all 1, m=1, 2, 3, let E,,, denote the 3 x3 matrix which is 1 in the 
(1, m)-entry and 0 in all other entries. Let a be the one-dimensional sub- 
space of ) spanned by the matrix ) = 2(E, - E,,). Then @ is a splitting 
Cartan subspace of ). Let @ be the linear functional on a which is 2 on h. 
Then the set = of restricted roots of g with respect to a is {ta, +2a}, g° 
is the set of traceless diagonal matrices, g* is the span of Ey and E53 
g~* is the span of E,, and E,,, 9? is the span of E,3, and g~?% is the 
span of E,,. Also, let h' be the matrix E,,~2E,,+8&,;,. Then the cen- 
tralizer m of a in € is the span of h’, and g° =m @a. 

Let 2, be the positive system in 2 consisting of @ and 2a, Then a 
is the unique simple restricted root. Since a(h) =2, h= hg, as defined in §2. 

The Killing form B of g is given by the formula B(x, y) = Gtr xy. Thus 
on g~*, the form Bg(x, y) = -—B(x, Oy) is given by the formula 


B,(aE,, + bE,,, cE,,+ dE ,,) = -6i(ad + bc) 
(a, b, c, dé k), and on g~?%, Bp is given by 
Bg (aE, ,, bE,,) = Gab 
(a, k). Hence + iE,,), (12)- + E,,)} is a Bg-ortho- 
normal basis of g~*, and {67 ade is a Bg-orthonormal basis of g™ 7m, 
Since the canonical elements p_, € 5*(g~%)™ and € $?( 9-24)" (see $4) 


are the sums of the squares of the members of Bg-orthonormal bases of g~* 
and g~*%, respectively, we have 


p_,=(i/3)E,,E,, and p_,,=(1/6)E5,. 


The element x, € a (see $2) is (1/12)(E,,- 3), so that (a, a) = 


a5, a5, ia,, and 0 -ib,, 
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x.) = 1/12. Hence 
m 
= 24Np_,) = 4i(E,,E,, + E,,E,,) = 8iE,,E,, + 4iE,, 


and 


97.20 = 6M -a 


in the notation of $5. We may choose r_,,=E,, € g™ 22 (see Theorem 8.6), 
since dim 92% =1 and Ei = 4_4,° By Theorem 5.1 (Case 3), Pinte is the 
polynomial algebra klq_., 

Let v € a*. We want to determine the conical vectors in the twisted in- 
duced g-module X” = V”~ induced from the subalgebra m @a@n of g, 
where p=2a€ a" and n= 9°@ (see $2). Let be the canonical gen- 
erator of X”. Then 


Thus we must determine the polynomials a, in two variables over k such 
that n+ * Xo) = 0. 

It is hard to guess what conical vectors should look like, but once we 
know, it is relatively easy to prove that they are in fact conical (in the pre- 
sent special case): 


Lemma 9.1. Suppose v(h,) = 21, | a positive integer, and let 


x =(q_,-4ill- Dr_,.)(q_, 4ill 


(q_, + 4i(1- 3)r_,.)(q_, + 4ill- I)r_, 


a) * Xo 


in X”. Then x is a conical vector. 


Proof. Since E,,=[E,,, E,,], g” generates n, and so it is sufficient 
to show that E,,+x=E,,+x=0. By straightforward computation, using the 
matrix product relation E,,E5=E,5 if B=y and =0 if B# y (a, B, y, 
5 = 1, 2, 3), we have the following commutation relations in the universal 
enveloping algebra of Q: 


[E, =4iE,, + 2iE,,b. + 4iE,,h’, [E 


[E,,,9_,]=4iE,, + 2iE,,h, -4iE,,h’, [E 


Let be any one of the factors q_, + 1), 3), 
1-1) appearing in the expression for x in the statement of the lemma. Then 
[he a) = -4a and [h’, a] =0. Also xy=(v- p)(h.)xo = (2/-4)x9 and 


h' 0. The above commutation relations thus give 
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- - 3)r_,,) 


a 


+ + x9 


= (4iE ,, + 2iB , + 4iE,,h' + 4i(1- 1)E,,)(q_, - 4i(1 - 3)r_,,) 


a 


+(q_, 4i(1—1)r_,,) (4iE + 2iB , + 4iE, + 4i(1-3)E,.) 


= (4iE ,, + 2iE (-4( - 1) + 21-4) + 4i(1- DE, 4i(/-3)r_,,) 


eee + 4i(]- I)r_, )- Xo 


a 


+(q_,-4i(1- Dr_,,)(4iE + 2iB , -2) + 21-4) + 4i(1-3)E,) 


=0+0+-+-=0. 


A similar computation shows that E 23 * *9 = 0. However, x must be written 
in the ‘‘opposite order,’’ as 


(q_, )(g_, + 3)r_,) 


ves (q_.- 4i Dr_,.) + Xo, 


to make the computation exactly parallel to the above one. Q.E.D. 
Remark. Because of the flexibility allowed in writing the expression for 

x in either order in the above proof, we could prove easily that x is conical 

without appealing to the difficult commutation relations in Jl. This flexi- 

bility is lost for Lie algebras g in which the double root space 92% is more 

than one-dimensional, since the “‘square root’”’ r_,, of ¢_>, does not exist. 
Now we turn to the uniqueness of the conical vectors. 


-2a 


Lemma 9.2. Let aly, z) bea polynomial in two variables over k. Then 
4(9_.5 75.) * %9 is a conical restricted weight vector in X” if and only if 
either ay is a nonzero scalar or else v(h,) =21, where 1 is a positive inte- 
ger, and ay is a nonzero multiple of 
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a, = (y — 1)z)(y 3)z) (y + 3)2) (y + = 12). 
If 1 is even, then 


= Tl 167224, 
j=1; j odd 


and if 1 is odd, 


a=y  (y? + 16;?z?). 
j=2;j even 

Proof. Let §= g° =m @a. Then § is a Cartan subalgebra of g, and 
the elements y of § canbe written y= y,E,, + y,E,,+y3E3,3, where 
y, €k and + y3 = 0. Define Aj, A, A, € §* by the formulas 

Then the set R of roots of g with respect to § is itA,, tA., A}. Denot- 
ing the root for with respect to § by we have =kE,,, 

=kE,,,9°=kE,,,9 1=kE,,,9 *=kE,, and g 3=kE,,. Let 
R, ={d,,A,, A,} so that R, is a positive system in R. Then the previous- 
ly defined subalgebra m @ a @®n of Qg is the same as the Borel subalgebra 
b= g* R,), and t= (A R,). Let € be the linear 
functional which is the previously defined p on @ and0on m. Then p’ = 
Y(A,+A,+A,), i.e., p’ is half the sum of the positive roots of 9 with re- 

P 
spectto 5. Also, define v’ €5* by v’=v on a and v’=0 on m. Then 
the previously defined twisted induced g-module X” is the same as the Verma 
module associated with v’, in the sense of [2, $7.1.4]. That is, X” is the 
g-module induced by the character of 6 which is v’—p’ on § and 0on n. 

In order to describe the Weyl group W, of g with respect to §, let 5, 
be the space of all (not necessarily traceless) 3 x 3 diagonal matrices and 
let Ho» € be the basis of dual to the basis E,,, E,,, E;, of 
6. Now 5* may be identified with the space of k-linear combinations of /,, 
and modulo the subspace k(u, +p, + Then W, is the group of 

automorphisms of §° induced by the six permutations of p,, #, and 3. 

Let v, € a*, and define vi € §* tobe v, on @ and Qon m. Then x, 


€ X” is a conical vector with restricted weight v, if and only if x, is a 


(nonzero) n-invariant vector with weight v', for the action of § on X”. But 
there exists a nonzero N-invariant vector in X” with weight v,€ 5 only if 
there exists w€W, suchthat v,+p =wv andv — (v, +p) is a nonnega- 


tive integral linear combination of the elements of R,, by [2, Proposition 
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7.6.2]. Moreover, the n-invariant vectors in X” with weight v, form at most 
a one-dimensional space, by a theorem of Verma [2, Théoréme 7.6.6]. Let Z 
be the intersection of the conical space of X” with the restricted weight 
space corresponding to v,. It follows that if Z # 0, then dim Z = 1, and in 
this case, either =v—p, orelse v, =-v—p and v=/a (i.e., v(h,) = 
21), where ] is a nonnegative integer. Now apply Lemma 9.1. (If / = 0, then 
v=0,v,=-p and Z is the span of xp.) Q.E.D. 


10. Conclusions. We are now ready to combine the results of $$5, 6,8 
and 9 to remove the hypothesis ‘‘2a ¢ =” from Theorems 6.17 and 6.18, 

Let (g, 6) be a semisimple symmetric Lie algebra over the field k of 
characteristic zero, g= € ® the symmetric decomposition of (9g, 9), a a 
splitting Cartan subspace of ), = C a* the corresponding restricted root sys- 
tem, 2, CE a positive system, and p € a” as defined in $2. For every 
PES, define bi, €a tobe hy if dim g®>1 (see $2) and 2hy if dim g® 
= 1, Let sy be the Weyl reflection with respect to ¢ (see §2). Also, let G4 
and 4,4 be the elements of the universal enveloping algebra of g defined 
in $5; if 26 ¢ take 0. 


Here are our main results, which generalize Theorems 6.17 and 6.18: 


Theorem 10.1. Let a€, be a simple restricted root and v € a*, Let 
Y be the subspace of the twisted induced 9-module X” spanned by the coni- 
cal restricted weight vectors with restricted weights of the form v-p + ca 
(ce k); if dim a=1, then Y is the conical space of X”. Then dim Y is 
either I or 2, If v(h‘.) is not a positive even integer, then Y is the span of 
Xo, the canonical generator of X”, Suppose v(h’,) = 21, 1 a positive integer. 
Then dim Y = 2. Define the element ¢ in the universal enveloping algebra 
of g as follows: If dim g*>1 and 1 is even, 


l-1 


C= IT (q?., + 16j7q_, 
j=1;j odd 


if dim g°>1 and I is odd, 


) 


a’? 


2 2 
II (42, + 


j=2;j even 


and if dim g° = 1, ¢, = f', where { is a nonzero element of g~*. Then Y 
has basis and + is a conical restricted weight vector in 
X” with restricted weight sv —p. 


Theorem 10.2. Let a be a simple restricted root, let p, v € a*, and sup- 
pose that p—v is of the form ca (cék). (If dim a=1, then this is automa- 
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tic.) Then Hom,(X", X”) is at most one-dimensional, and dimHom 9X", x”) 
=1 if and only if either p=v, or else p= s,v and v(h)) is a nonnegative 
even integer. Moreover, dim Hom,(X", X”) =1 if and only if X” is isomor- 
phic to a g-submodule of X”. 


Proof. Theorem 10.2 follows from Theorem 10.1, just as in the proof of 
Theorem 6.18. To prove Theorem 10.1, note first that the case 2a ¢ & is 
covered in Theorem 6.17. Suppose that 2a €%. It is clearly sufficient to as- 
sume now that k is algebraically closed. By Lemma 6.16, Y = or. . a 
Moreover, is the polynomial algebra if dim >1 and 
is the polynomial algebra 


a! if dim g?*=1, by Theorem 
5.1; here r_,, € g~ 2% and ae = 4_>, (such an element exists since k is 
algebraically closed). Hence Y is the set of m @ n-invariants in X” of the 
form * if dim g?*=1 and of the form * 
if dim 9?* >1, where a, ranges through the polynomials in two variables 
over k, The stage is set for the application of the transfer principle for coni- 
cal vectors (Theorem 8.6). Suppose that dim g** = 1, and that 
+X» is a conical vector. If v(h,) is not a positive even integer, then ay is 
a nonzero scalar, by the last part of Theorem 8.6, combined with Lemma 9.2. 
Suppose now that v(h,) = 2/, where / is a positive integer. Then the same 
two results show that a,(q_.-17_>,)* %g is a (nonzero) linear combination 
of Xp and ¢ * Xo, in the notation of the theorem. Conversely, ¢ * Xo is, in 
fact, a conical vector, again by Theorem 8.6 and Lemma 9.2 (or Lemma 9.1). 
This proves the present theorem in case dim g?* = 1. If dim g?* > 1, the 
theorem follows from the same argument, this time using the first part of Theo- 
rem 8.6, Note that since the polynomials a ; in Lemma 9.2 are polynomials in 
y and z?, the space Y has the same description whether dim g* =1 or 

dim >1. Q.E.D. 

Remark. (Cf. the Remark following Theorem 6.17.) In the notation of 
Theorem 10.1, v(h‘) is a nonnegative even integer if and only if X” con- 
tains an M-invariant restricted weight vector with restricted weight s,v — p, 
or equivalently, a conical restricted weight vector with restricted weight 
S,Vv-p. But in general not every M-invariant restricted weight vector with 
restricted weight s,v—p is conical. 

Remark. If dim a =1 and dim g*>1, then v(h)) = v(h,) is a nonnega- 
tive even integer if and only if v is a nonnegative integral multiple of the 
unique simple restricted root @, 
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ABSTRACT. The objectives of this paper are to generalize the Mar- 
tin’s 2?-minimum problem under more general additional conditions given 
by bounded linear functionals in a bounded domain D in C” and to apply 
this problem to various directions. 

We firstly define the new ith biholomorphically invariant Kahler metric 
and the ith representative domain (i = 0, 1, 2,...-), and secondly give es- 
timates on curvatures with respect to the Bergman metric and investigate 
the asymptotic behaviors via an A-approach on the curvatures about a 
boundary point having a sort of pseudoconvexity. 

Further, we study (i) the extensions of some results recently ob- 
tained by K. Kikuchi on the Ricci scalar curvature, (ii) a minimum prop- 
erty on the reproducing subspace-kernel in £5, and (iii) an extension 
of the fundamental theorem of K. H. Look. 


1. Introduction. The Bergman’s minimum problem [3] with respect to 
£2(D) under some additional conditions has been extended by W. T. Martin 
[15] as the following (originally posed by W. Wirtinger [21]): Find the func- 
tion /(z) (belonging to £°(D) or Li. D)) which minimizes the Lebesgue 
square integral (0 - /, Q-/),, for a given function Q(z, z) € L*(D). Here 
L*(D) and £22(D) denote the classes of square integrable and of square inte- 
grable holomorphic functions in a bounded domain D, respectively. Ly. AD) 
denotes the class {/(z) 27(D)|/(2) = X, t € 


In $3, under more general additional conditions using bounded linear 
functionals we shall get the generalized Martin’s theorem, which includes 
the cases of Bergman 3], Martin [15] and others [17], [19], [20]. 


As an application of the minimum problem, in $4 we shall define the 
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interesting quantities 22) and 622) (i=0, 1, 2,...) which have a 
sort of positivity and play important roles throughout this paper. Using 
these, we shall define the new ith biholomorphically invariant Kahler metric 
(ds())? log det Z) and the ith representative domain (i = 
the biholomorphically relative invariants 2) 
(i= 0, 1, 2,...) are constructed by the Bergman kernel ension of a bounded 
domain D and its derivatives. In particular, (ds (0)? and (ds())? coincide 
with the Bergman metric [3] and the Fuks metric [8], respectively, and the 
Oth representative domain coincides with the Bergman representative domain. 
In $$5, 6 and 7, using the results of $$3 and 4, we shall give various 
estimations (Theorems 5.1 and 5.2) on the holomorphic ‘‘bisectional’’ curva- 


ture R>(z; u, v), the Ricci curvature C,,(z; u) and the Ricci scalar curva- 


ture S,(z) of a bounded domain D with respect to the Bergman metric and 
generalize the results obtained by S. Bergman [1], [2], [3], B. A. Fuks [6], 
[8] and others. For our purpose, the quantity 22 Xz) and ‘‘the method 
of minimum integral’’ [3], [7] are used effectively. 


In the case of C’, the asymptotic behaviors of the Bergman kernel func- 


tion k,,(z, Z) and related biholomorphic invariants about a boundary point Q 
of a domain D such that the Levi determinant L(¢) is positive at Q have 
been studied minutely by S. Bergman [1] and B. A. Fuks L6], [7], L8]. But 
in the case of C” (n > 3), few results are known (see Chalmers [4], Hér- 
mander [9]). On the asymptotic behaviors of the curvatures of a bounded do- 
main D in C” about a boundary point Q at which D is strictly pseudoconvex 
globally representable [4] and has the normal analytic hypersurface h 
(through Q) lying entirely outside itself, in $7 we shall prove that, using 

a sort of domains of comparison due to B. Chalmers [4], Ro kz; u) (= Rp; u, v)), 
Cp(z; u) and S,(z) tend to -2/(n + 1), -1 and -n via an A-approach: 

z — Q, respectively. 

In $8, some results recently obtained by K. Kikuchi |12] with respect 
to the Ricci scalar curvature as an application of the theorem of E. Hopf 
are extended. 

In $9, using the minimum problem with the condition that Q(z, Z) = 
Q(z) = kp (2 7) £2(D), where ky (z, t) denotes the Bergman kernel func- 
tion of D, we shall show that the reproducing kernel function of a subspace 
22. (D) of £7(D) (see [5], L18]) has a sort of minimum property and give 
another expression of this kernel given in [5]. 

Finally, in $10 a neat proof and an extension of the fundamental theo- 
rem (I) of K. H. Look [14] are given. 
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2. Preliminaries. Throughout this paper we shall use, as far as pos- 
sible, matrix representations, which give us available perspectives. For a 
matrix A, A, A’ and A* denote the conjugate, the transposed and the con- 
jugate transposed matrices of A, respectively. The symbol x shows the 
Kronecker product and [A]* denotes A x+++x A (k-times). 

Let D be a bounded schlicht domain in C” and z= (z,, pein — be 
a complex nx 1 vector variable in D. For the differential operator D_ = 
0/dz = (d/dz,, 0/dz,) = A/dz™ = (A/dz)"), we shall define two 
sorts of the kth order differential operators with respect to z as follows: 


= [0/dz]* = (0/dz) x +++ x (0/dz) (1x vector) 


and its contraction 
= d*/az* 
k k 


(1x vector), where k, =k and the arrangement of 
is lexicographical. Using these operators, the kth order derivatives of a 


matrix function F(z, Z) = (f, (2 Z)) with respect to z are defined by 


(p,}*F(z, 2) = [D,}* x F(z, 2) = x f, (2, 2) 


DE F(z, Z)= x F(z, Z) = x 


If we define the contracted kth power of an x 1 vector u=(u,, ..-, u)T 
as 


it holds that, for a scalar function /(z, Z), 
(DE f(z, 2))u* = 


The total differential of a matrix function F(z, Z) (rx s type) is de- 
fined by 


dF(z, Z)= + F (D_F\(dz E.) + (dz* x E (DSF), 


where dz = (dz,, ‘wan dz)" and E, denotes the kx k unit matrix. 
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In the following, we shall use some available formulas with respect to 
matrices, derivatives and differentials without proof [12], [16], [17]: 


(2.1) D (AB) = (D_A)E,, x B) + A(D_B) 


(A, B are kx l, 1x m matrices, respectively), 


(2.2) D(A x B) = (DA) x B+ (Ax x E,) 


(A, B are kx 1, px q matrices respectively and 


where ei (i=1,..., 1; 7=1,...,m) is an 1x n matrix which has 1 as 
(i, j)-element and 0’s elsewhere), 


= = -A~ (DA)(dz x A~"), 
(2.3) 
D{A~") =-A~ DAME, x 


(A is a kx k regular matrix) and 
(2.4) d_ log det A = Sp(A~ '9,A) = SpiA~ x E,)} 


(A is a kx k regular matrix and Sp denotes the trace symbol). By (2.3) 
and (2.4) we have the following lemma. 


Lemma 2.1. Fora kx k regular matrix function A(z, Z) we have 


* * -1 -1 
(2.5) logdet A = x E, “Ay )(dz x 


where Ai, denotes etc. 


Let H(D) be the class of holomorphic matrix functions of all types in 
D and BH(D) be the subclass of H(D) defined by 


BH(D) = {f(z) = (/,(2), € H(D)|J {z) #0 in DCC}, 


where J {z) denotes the Jacobian determinant det (df{z)/dz) (=det(D_/(2))). 
We call each-element belonging to BH(D) a biholomorphic mapping, which 
is locally one-to-one in D. The subclass £7(D) of H(D), which denotes 
the class of square Lebesgue integrable holomorphic functions in a bounded 
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domain D, makes a complete Hilbert space with the Bergman reproducing 
kernel function k,(z, 7). 


3. General minimum problem. In this section, we shall generalize the 
results of S. Bergman [3], W. Wirtinger [21], W. T. Martin [15] and others 
for a given complex-valued rx 1 vector function Q(z, Z) € L*(D) anda 


general class (with more general additional conditions) 
£7 (D) = {/(z)(rx 1 type) = k, 2 BL(D)}, 


where BL(D) denotes the class of all types of bounded linear functional 
matrices (see [5]) and K denotes a given constant matrix of the same type 


as 


Theorem 3.1. Fora given rx 1 vector function Q(z, Z) € LD) ina 
bounded domain D, the minimizing function MK o(2) € L7(D), which mini- 


mizes the Lebesgue square integral 


under an additional condition 
(3.2) Lf = K (K: a given constant matrix, 2 € BL(D)) 


with the condition det(®*®) 4 0 for ®= = (¢,@), 


an orthonormal system in £*(D)), is given ty 

(3.3) Mp, o(2) = 1B + (K- 
and also the minimum value of I(Q, {) is given by 

(3.4) AK 9 = SpiBB* - 


where denotes the Euclidean volume element a, A 
and 


(3.5) B=(b,)= [AG 


Proof. Given a sufficiently large real number M, we consider a class 
G=tf(z)e L2(D)\Sp \f(2)| < M <-+00}. G becomes a compact family, and 
it is known that there exists a minimizing function MB(2) = M5, o=0(?) € 
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L2(D) which minimizes the integral I(0, /) = f, If(z)|7,, where MK(z) is 
given by and det(®*®) 0 (see [3]). 

Now, we will follow the procedure of the proof essentially due to Mar- 
tin [15]. Let mK be the minimizing function to £2 then, 
using an in D, we can set Mp, o() = Adp(2) 


where A =(a,.) = bp (day denotes the Fourier coefficient r x 
matrix to be Noting that o= ALY, = = if we set 


KA) =(Q- MK O- ME - - 


where A = (,) and P=(y,) (i=1,...,p;j7=1,...,7 and p denotes the 
number of the columns of K) are the Lagrangian multipliers, as necessary 
conditions we must have the Euler’s conditions 


dK A)/da;; =0, ie., A 


a A= 8+T*O*, 


where i=1,...,7;7=1, 2,... and \) denotes the (i, /)-element of 
@A. Hence we ions MA = or. But since det (®*®) 4 0 holds in a bounded 
domain, we obtain A=TI. On the other hand, as we have K = AD = 


(B + = BO + A*(0*9), we get 
A=B+A*®* = B+(K- 


Therefore, we must have (3. >) belonging to (dD). 

In order to prove that mk (z) is the minimizing function required, let 
us consider the class 2p) = {e(z) £(D)|2(z) = C® = O}. If we 
set F(z) = Ms g(2) + ele) for each g(z) € £? 90D), then it is easily shown 
that F(z) is an aes function belonging to £2(D). It follows from term- 
by-term integrability (see |15]) that 


= BC* - AC* = BC* -(B+ A*6")c* =-A*(co)* 


where f, (Da, = Hence we obtain 


and 
0, 
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(Q- F, Q- F)y=(Q- MD ME +(e 
—2Re Sp fp Mb, 


=(Q- M5, Q- M5, op + (g, g), >(Q- Mp. o)p 


for any g(z) # 0. This completes the proof. 
Remark 3.1. In Theorem 3.1 it is easily verified that the minimizing 
function without an additional condition (3.2) is given by 


Mp ol2) = Bbpl2)= f OG $) = Ob p(2), 


where kp{z, 2) denotes the Bergman kernel function [15]. 

In the case that Q(z, Z) = 0 in D, the minimizing function MR(z) = 
o=0(2) and the minimum value AK = 0<0 are expressed in terms of 
the kernel function of D and its derivatives [3], [20]. 

Let £, m)= m) be an element of BL(D) and and 
£ Pe the linear £ (m) and £ , evaluated at a point 
te D. 22 (m and denote the subclasses of £2(D) such that 
{/(z) € my = K(m) = (Aj, ..., A,)} and t/(z) € yf = Kim, 
respectively. dere denotes, say, any one of /(¢), A 
So{(@)dz and and so on. 

Theorem 3.1 gives the generalizations of (i) [15], . (ii) [15, (5.5)], 

(iii) [3], [20] and (iv) [19] under the additional conditions 

(i)’ Q(z, Z) L(D), m),tl = K(m), t € D, 

= K(m), t t, € D (k= 

ii)’ Q(z, 2) = 0,2.) f= (Ly where 
(DE/(2))u, (u, denotes a constant xi 
denotes an integer to {1, 2,..., ,H,} (,H,: repeated 
combination), and 

(iv)’ O(z, Z)=0,£ 


spectively. O 


k matrix (kR=1,..., m) and i, 


(2),¢! = = (/(2), Sof Dez) = K(2), re- 

In the following we shall use the abbreviated notations /; (z, %) and 
%) instead of (z, %) and (z, x), ‘Tespectively. 
In particular, %) denotes /(z, %) and /, (a, 5) means 

In a bounded domain D, the Bergman havent function k mes Z) is posi- 
tive and relatively invariant under BH(D) and log kz, 2) defines a strongly 
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plurisubharmonic function. Therefore, an absolutely invariant Kahler metric 
under BH(D), which is called the Bergman metric, is defined as 


(3.6) ds? = dz*T p(2, 2dz, 


where the fundamental tensor 


T p(z, = D*D, log kp (z, 7) 
(3.7) 
= {k(z, T) x k, ,(z, T) - x ko Cz, 7) 


belongs to H(D x D*) when &(z, Tf) = k (z, T) # 0 and has the relative in- 
variancy under BH(D), where k, Az, T) denotes Ry if T), etc. 
The following lemma is known [2], [3], [7]. 


Lemma 3.1. We consider the case that Q(z, Z)=0 in D. 
(i) Under f= ({(, = K(2) = (A, A,) we have 


k 


01 kz, 7) 


(3.8) ME t) =(A, 


where 


Rig 11 


(3. 


—(kT)~ 


= Rp and T= T p(t, 
In particular, under K(2) = (0, E,) we have 


(3.10) Ap = Sp(kT)~1. 

(ii) Under Liane = (/(2), D_f (t)u) = K(2) = (0, 1) we have 
(3.11) ADMt) = APXu) = 1/ku* Tu. 

(iii) Under Lif = ({(t)) = K(1) = (1) we have 
(3.12) = At = 1/k. 


(iv) Under 2... f= (0, x v)) = K(3) = (0, ..., 0, 


we have 


—_ 
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(3.13) Apo Me) = ADu, v) = Xu x v) x v), 
where 0°22) is defined in (4.5). 


Remark 3.2. For a regular matrix A = ted pak if K and Z=N-—MK~!L 
are regular, then we have 


(3.14) Atle 


where X = K~!L and Y = MK~}. 


4, New invariant Kahler metrics. 
Definition 4.1. We define the two sorts of matrices: 


2), pG-1) 
(4.1) 2) = 
(PG-1)*, 


ii 


i= 0, 


KG-1Xz, 2), p@-)) 0,i-101 


(i-1))* 


where (ke or denotes DA(D>)? Z)}, etc., and Ko and xe? are 
s(i) x s(i) and {s(i - 1) + nt(i- 1)} x {s(i 1) + nt(i 1} matrices, respec- 
tively. ifere ¢(7) and denote |H, and aotl) (= ("7 respectively. 


Lemma 4.1. In a bounded domain D, we have 


(4.3) det zZ)>0, det KEXz, Z)=0 (i>2 in the latter), 


and 


(4.5) 


* (i) 
(u" x x 
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for i>0, where t(i- 1) = 


Proof. det z) =k,(z, Z)>0 in D is clear. Since exists, 
then we have det Kk) = t(z, Z) det T Z)>0 in D. 

Now, let us suppose that det KG- 1\z, Z)>0 in D. Under the condi- 
tion (/(z), D_{(2), (D°f(t))v) = (0, ..., 0, 1) = K(i+ 1), where v de- 
notes any nonzero ali x 1 vector, we obtain, from (3.4), 


Di-1) 
17) = det /det 
y*(pG-1)*, v* kv 


12 
= 1/kv >0 


and hence (2) is positive definite and also det Q(z) > 0 follows. 
Therefore, we have, from (4.1) and (4.4), 


det Kz, Zz) =k det Z) det > 0. 


Under the condition (/(¢), D f(t), Di- 17(2), fu x v)) 
= (0, ..., 0, 1) = K(é+ 1), where uw and v are nx 1 and 1 con- 
stant vector respectively, we have, by the same procedure as above, 


(u x v) * x v) =v x E Wu x > % 
which shows (4.5). 
Lemma 4.2. In a bounded domain D, we have 


log det 2) 
(4.7) 


ti 


Proof. Noting that 2) and (u* x 1z)(u x E.G) are 
positive definite from (4.4), we have by Lemma 2.1 


* 
log det Kp, 


dz* 0 0 0 dz 0 


= Sp ~ i 
* (i)y-1 * (i+1) 


= x Ex * x 0, 
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where s(i)=1+ H,+++++ and = since Sp(H,H,)>0 
follows when H, and H, are positive definite Hermitian matrices. 
Definition 4.2. Such an |H, x nit; matrix o({A) that 


holds for arbitrary nonzero vectors u = (uw), ut and v=(v,,..., 
is called the o-contraction of an n’ x n* matrix A. 

Further, for a linear transformation v = Au we define another contrac- 
tion SLA]* of [A]* as follows: v* = (S[A]*)u*, where u, v and A denote 
nx 1, mx 1 vectors and an mx n matrix, respectively. 


Lemma 4.3. Let g(z, Z) and w(z) be a scalar function and a biholo- 
morphic mapping in D, then we have 


(4.8) SLAB] = 

in particular, = u* and = (S[A]*)u*, and further we have 
;) = 


For an nxn matrix C anda natural number k we have 


(4.10) det = (der s(R-1) = (" 


Proof. (4.8) and (4.9) are evident from Definition 4.2. 
By the triangulation of C we have C = PSP~!, where P and S denote 


nxn regular and n x n triangular matrices, respectively. Since [c]* = 
and = d(LP]*)-! = hold, then we obtain 
det AE) = det (SLS]* - AE_), which derives (4.10). s(k - 1) is ob- 
tained from x k/n= H,k/n=, ,,H,_) = 


Lemma 4.4. Under w(z) € BH(D) we have the relative invariances: 
(4,11) det Kz, 2) = det (27%, >0, 
and have the absolute invariants: 
(4.12) 12) = det 


where A= w(D) and N(i) = + 
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In particular, for i= 1 we have a known absolute invariant: 
(4.13) = det D/kp(z 2) 
Proof. The Bergman kernel function k p\ Z) has the relative invariancy: 
(4.14) kp(z, Z) = Jka(w, for w(z) € BH(D), 


where J = J (z) = det(D_w). Let us set k,(z, Z) = kp and = kg; 
then we have 


Since 


db 
i=0 


j=0 
. ks x 


using the elementary theorems with respect to the determinant and the con- 
traction 


(4.16) = SLD , 


we have, by (4.10), 


det Kz, = oe Dog ee 


* 
ALD "ky wl? -- 
_ot(k)} 
“OL TT det 0, det 
q=1 


= 


= |J| 
where = nll, and s(k) = Rk). Since 


det 
n+i n+i n+i+l1 

k k) = = = ; 
( i ) =m, 


we have (4.11) and thus (4.12). 


= 
(4.17) 
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Theorem 4.1. In a bounded domain D 
(4.18) {))? = log det Z), i=0,1,2,-°, 
define the new invariant Kahler metrics under BH(D) (see (4.7)). 


Proof. The positivity of each (ds)? is given by Lemma 4.2. 
From Lemma 4.4 we can obtain the invariancy of (ds())? under BH(D), 
since we have 


log det Z) = log det + Wz) + dz), 


where y(z) denotes the scalar analytic function N(i) log ],,)s and 0_/(z) 
= (D_,f (zw) (D_w))dz = F(w))dw holds for a holomorphic function /(z) = 
{(z(w)) = F(w) under w(z) € BH(D). 

Remark 4.1. {ds (0)? and (ds()))2 coincide with the Bergman metric 
[3] and the Fuks metric [8], respectively. 


Corollary 4.1. In a bounded domain D, we have 
(4.19) + (n+ Tp = DID, log det (ef. L131) 
and for any nonzero vector u 
(4.20) u*(D*D, log det KG Nu = SpiT5 x E x E)}> 0, 


where, for the Hermitian curvature tensor (- Raa ), 
a 


apys 


(4.21) (R,,)= (= 
aB 


¥5)_ 7-1 
=-DID, logdetT,, (T”°)=T>', 


[13] denotes the Ricci tensor with respect to the Bergman metric. 


Proof. By Lemma 4.2 we have 


log det xo? = log(k” *! det T) = dz + (n+ 1)T) 


= Ndz* x BP x E,)} 


= Sp{T~ x E x E)}>0 


since = KW) holds, where k = kp(z, 2) and T = 2). 


Corollary 4.2. In a bounded domain D, let us set 
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(4.22) Ip = 2) x TH(z, 2), 

which is relatively invariant under BH(D) for arbitrary real number p and 
integer q; then 


(4.23) 4) = 9292 10g Ip 2) (= (z, 2) dz) 


D,(b.@) 


defines an invariant Kahler metric under BH(D) for each (p, q) such that 


np —(n+1)q>0 (n=dim D). Here kB (z, Z) takes values of the real posi- 
tive branch, 


Proof. Since Z)= Z)(det Z))4, then 


d? log *dz = pnT - > - (n+ IT) >0 


follows from (4.18) and (4.19). The invariancy of de> 0.4) follows from 
the relative invariancies of k, and T,. We can obtain the relative invari- 
ance Z) = for w(z) € BH(D) and 
A = w(D), where |J, (z)j 2(on +4) takes values of the real positive branch. 

Remark 4.2. The particular case of (p, q) = ((n + 1)/n, 1) (2 = dim D) 
was treated by Fuks |8] and tin? 1)/0,1) coincides with (ds(?))?, For 
(p, q) = (2, 1), ds}, (2 1) coincides with the Kato metric [11], which is valid 
for arbitrary n (n = dim D) and for (p, q) = (1, 0), asi, ¢1.0) denotes the 
Bergman metric. 

Under the restriction g= 1 and p> (n+ 1)/n, (i) the possible minimum 
value of p for each n (m= dim D) equals (n + 1)/n, which is the case of 
Fuks, and (ii) the possible maximum value of p for all n (n = dim D > 1) 
equals 2, which is the case of Kato. 

If D is a bounded homogeneous domain, dst .¢) is essentially equiv- 
alent to the Bergman metric for pn + q > 0. 


Corollary 4.3. In a bounded domain D, we have 


(4.25) (u* x E x E,)>0 (positive definite) in D 
and further 


Q (2 
(4.26) = 99- K21,007 9 D. 
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17,St 


Tx T p{z, Z) and ha ky(z, Z), and u and v denote nonzero nx 1 vectors. 


Proof. From (4.5) we have 
0°22) tk 53] (PO) 


Noting (3.9), we have (4.24) by straight calculations. 

It is known [3] that the ilermitian curvature tensor (-R Roa = 3) of the 
first kind with respect to the Bergman metric ds? = dz*T p\ Daz of D is 
given by 

)= 


= ~T2,p 2) 
<4.27) | * 
= -(E,, x TID (T~"D,T), 
where T = Tp (2, Z) and fae denotes the matrix of the Christoffel 
symbols. 


Theorem 4.2. The Hermitian curvature tensor with respect to the 


Bergman metric has the following expression: 


(4.28) -T, 2) = (Tplz, 2) x Tplz, DME, x E, + E,,,) 
(cf. [13]). 


292) is a relative invariant under BH(D). 


Proof. Noting that = kt io] = *Lo,] * io} 10 
and D* H= (D_H)* for an Hermite matrix H(z, Z), we have, by differentiating 
both sides of k? x T=kx ki, Ro, With respect to z and 


k? x (DED (k? x T)) - (DE (k? x T))T~ x T)) = k4 x (T, 27x T) 
+h?x x E,-E,,) 


since ky, x (ky, x T-T x ko,)» Noting that 
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T)x ko, = x (kg x 


ko) x (kg x = x (Rigx ko 


2 
ky /k =T +h 


we obtain 
2 
x ky ME, x Ey 
4 
ki, (ko, x - ki, x kok 
=(Tx x - 


Thus we get (4.28). 
Since T x T and T, p are relatively invariant under BH(D) [10], [13], 


[14] and [D = holds, then it follows from (4.28) that 
2? \z) is relatively invariant under BH(D). 


Theorem 4.3. For each i (i= 0,1, 2,...) the mapping 


(4.29) wi 2) = THz, Ddz+t, te D, 


defines the ith representative function, i.e., any domain ‘A in the equiva- 
lent class F = \{(D)\/(z) € BH(D), {(t) = D_f(t) = E,} is mapped onto 
the (unique): ith representative domain with center at t by the function 
w= w%(z), where THz, Z) denotes the fundamental tensor log det Zz) 
for the ith metric (4.18). 

A bounded domain D is an ith representative domain with center at t 


if and only if 
(4.30) Tz, T= TOL, 7) in D 
holds (see [17)). 


Proof. Since TX, Tt) is relatively invariant under BH(D), then we 
have w= wz) = w XC) under any €(z) F. The latter half of the 
theorem is easily obtained by w (Xz) =z in D. 


5. Curvatures and estimations. For the general sectional curvature 
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Rp(z; 4 v, u, v) (which is the expression in differential geometry) and a 
complex structure J, the holomorphic bisectional curvature with respect to 
the Bergman metric is defined as R,(z; u, Ju, v, Jv) (S. Kobayashi). After 
some direct calculations we can show that R p&3 u, Ju, v, Jv) coincides 
with the unitary curvature R p&3 u, v) due to Hua [10] (see (4.27)). Now, 
we shall give the matrix expressions of the holomorphic bisectional curva- 
ture R>(z; u, v) (of course, Rp(z; u, u) coincides with the holomorphic 
sectional curvature R pi u)), the Ricci curvature 


4) = pu 


and the Ricci scalar curvature 


apy 


in terms of T = T(z, Z) (Bergman metric tensor) and tT.» = T, p z) 


(see (4.27) and (4.28)). 


Lemma 5.1. For a bounded domain D in C” and contravariant section 


vectors u and v, we have 


(5.1) Rplz; u, v) =—(ux plu x v)/u*Tuv*Tv, 


(5.2) 4) = -SpiT~ "u* x plu x E )V/u*Tu 


and 
(5.3) = -Sp(T~! x T7)T, 
which are absolute invariants under BH(D). 


Proof. Using the formula (2.5) and (4.19), we obtain 
C plz; 4) = -u*(D*D_ log det T)u/u*Tu 
= -SpiT~ (u* x 2 pu x E 


The biholomorphic invariancies of (5.1), (5.2) and (5.3) are easily ob- 
tained by the relative invariancies of T and T, ,, under BH(D) [14]. o 


For an nxn matrix B = (,) and nx 1 vectors 


M,=(0,..., 0, 1, 0, — 


= 
0)? 
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where 1 occurs in the ith position (i= 1, ..., 2), we have 


n 
T = 
(5.4) M/BM;=6;» M; BM, = Sp(8). 


i=l 


Lemma 5.2. Let v, be the mutually orthogonal sections ee" 


(i =1,....) such that v; Tv, MIM, = then we have 


(5.5) Cp x) = > R v;) 


i=1 


and 


j=l i,j=1 
Proof. From (5.1) for v = v;, noting v; Tv, = 1, we have 
R u, v;) = 1/2 ET 2, piu x 2M /u* Tu. 
By summation with respect to i we obtain, from (5.2), 


Rplz; v) =-SpiT~ ux E)Vu"Tu = Cp(z; u). 
i=l 


By the same procedure, we have 


n n 
j=1 i=1 


j=l 
—Sp{(T~ 1/2 x 1/2 x 1/2)} 


=-Spi(T~! x T~")T, 


Theorem 5.1. Let A“, A{2%Xu) and Gu, v) be the minimum values 
in (3.12), (3.11) and (3.13) at z in a bounded domain D, respectively, and 
€ = v) be |u*Tv|?/u*Tuv*Tv for n>2 and €=1 for 
n=1 and €,(z; u, u) = 1); then we have, for any sections u and v, 


Rplz; u,v) =1+¢€-(ux v)*A(ux v)/u*Tuv*Tv 


(6.7) = 14 v) <2 (cf. (2), Li9)), 
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Cp(z; u) = 2+ 1-Sp{T~ x E x E )V/u*Tu 
(5.8) 
(A v))-! <n+1 (cf. [4)) 


i=1 


S = nln + 1) - Sp(T~! x 


n 
=n(n+1)-A v))-? <n(n+ 1), 
i,j=l 
where 22%Xz) and v,= (i=1,...,m) are given in (4.4) and 
Lemma 5.2, respectively. 


Proof. By (5.1), (4.28) and Lemma 3.1 we have (5.7). 
Since it follows from (3.11) that Av ) = AOD), then we have 


C plz; u) = Rp u, v;) 


=n - SpiT~ "u* x x 


=n+1-SpiT~\"u* x E x E )WV/u*Tu 


for any section vector u= >" _, bv, = 1). (5.9) follows from 
(5.8) and (5.6). 

Remark 5.1. u) = Rp(z; u, u) = 2- u) < 2 
[2] and R (2; u,v) <2 [10] are known. 

Let u, and vy be any orthogonal vectors such as ujTv, = 0; then we 
have, for n > 2, 
(5.10) Rplz; uy <1. 

In a bounded homogeneous domain D, the absolute invariant ey Xz, z) 
under BH(D) (see (4.13)) equals a positive constant in D. Therefore, a 
domain D with if = constant or a homogeneous domain D satisfies, for 


any section vector u, 


(5.11) Cp lz; u)=-1 and S,(z) =-n in D. 


Let G be a bounded domain in c'" then we easily have Rf; u, v) = 
(z; u) = C-(z; u) = S-(z). If G is also homogeneous, we have 
R -(z; uv) =-1 in G since G is symmetric by Cartan’s theorem and 
hence is simply connected. 


and 


SHOZO MATSUURA 


Theorem 5.2. Let D be a bounded domain in C” (n> 2); then we 
have, for any section vectors u and v, 
(5.12) —n+€+Cp(z; u)<Rp(z; v)<1l+e in D. 


In particular, if D is homogeneous, then we have, for any section vec- 
tors u and v, 


(5.13) —(n+ I)+e< Rplz; u, v)<1l+e in D, 
(5.14) —n<Rpfz;u)<2 in’ D (cf. [10]) 
and there exist some vectors u' and v' such that 

(5.15) R,(z; v') <0 in Dz 


Proof. Let A be a positive definite Hermitian 7 x n matrix and 
v'= T~!/2P be a vector with P*P = 1 i.e., v denotes a vector 
where P=(p,,..., p,)* and v, = T~ /2y. (see (5.4)), then we have 
v*Av <Sp(T~!A) (inequality for n > 2 and equality for nm = 1). For any 
vector v with v*Tv = 1, we have (5.12) from (5.7) and (5.8), since we have 


(u x x v)/u*Tuv*Tv < SpiT~ (u* x x.E )/u*Tu 


from (4.25). 
If D is homogeneous, we have (5.13) from (5.12) and (5.11). (5.14) is 
easily obtained by Ep (2; u, u)=1 in D. From (5.5) and (5.11) we have 


Rp of <-1 xp Rp u ot 


u,v u,v 


and hence (5.15). 


Theorem 5.3. Let D be a bounded homogeneous domain and 
(u* x E )T, p(ux E,) be nonnegative definite (resp. positive definite), 
then we have, for n> 2, 


(5.16) -1<Rp(z; u,v) <0 (resp. -1< Rp (2; v) <0). 


Proof. For any section vector v = T~!/2p with P*P = 1, we have 
Rp v) = -P*OP/u*Tu, where = T~!/%(u* x ET, pu x 
= (U: unitary nxn matrix and A, >+++ >A, > 0), since 
T = 2) and (u* x pu x are positive and nonnegative 
(resp. positive) definite, respectively. Set UP =S= (s, coon ae then 
we have S*S= 1. Let D be a homogeneous domain with Q > 0, then it fol- 
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lows that -1< S plz; u) = -Sp(0)/u*Tu ~ A/u*Tu and thus 
=u*Tu> 0, i.e., A, > 0. Hence we get 


n 
<-A, > A;< Rp u, v) 
i=l 


i=1 i=1 i=1 


Example 5.1. Any classical Cartan domain D satisfies that 
v*(u* x ET 2 piu x E_)v > 0 for any section vector v. Therefore, (5.16) 
holds in D. Let R(i) (i =I, I, Ill, IV) be the classical Cartan domains 
(four main types of irreducible bounded symmetric domains), They are homo- 
geneous, and the following hold [14]: 


—2/(m+n)< u) <-2/m(m+n) (m>n>1), 
-2/(n+D< Raq 4) $-2/nln + 2), 
-I/(n-1)< Rea u)<-1/[n/2\(n-1) (n>2), 


For the n-polydisc P and the unit hypersphere E 


(5.17) -1<R,(z;u)<-1/n and R,(z;u)=-2/(n+1) in D 


hold, but in general Rp (z; u, v) is ‘not constant’’ for arbitrary vectors u 
and v. 


6. Domains of comparison. The basic tool used here and in the next 
section is the so-called method of minimum integral [3] or the principle of 
minimum problems [7]. 

Principle. Let ar (™\t) and — t) be the minimum values defined 
in $3 for two domains A and B with ACB under the same additional con- 
dition K(m) at t € A; then we have 


(6.1) < 


Theorem 6.1. Let A and B be domains of comparison of a bounded 
domain D(ACDCB) and e,(u, v) = €p(z; u, v); then we have, for z € A, 
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(1 + €,(u, v) - R,(z; u, v))/A, v) ep(u, v)- Rplz; v) 
(6.2) <(1+ v) - R u, v))A, nits v), 


(n+1- C, (2; u))/ u)<n+1- u) 
(6.3) 
<(n+1-C,lz; u))AV2(u, u) 


and 
(6.4) (nln + 1) - < n(n + 1) - Sp (2) < (nln + 1) - S,(2))¥ 


where 


Ag glu v) = AP Xv) 


= k2u*T ,uv*T ,v/k2u*T,uv*T gv 


= )(1)/),(1 
Pap = An = ky 
Proof. By Theorem 5.1 and Principle we have 
1+ € plus v) - R plz; u, v) = AP Wu, v) 


< (1+ €,(u, v) - w v))Ag v); 


etc. Thus we have (6.2), (6.3) and (6.4) by the same procedure. g 
By Theorem 6.1 and the biholomorphic invariancies of curvatures, we 
have the following: 


Corollary 6.1. (i) If A and B are image domains of the unit hyper- 
sphere and ACD CB holds, then we have, for z € A, 


(6.5) A1 -vA4 u)) < Rplz; u) -v/A, u)). 


(ii) If A and B are homogeneous domains of comparison of a bounded 
domain D, then we have, for z € A, 


(6.6) (n+1)1- u)) Cplz; u) < (a+ IL - v/ u)) 


and 
(6.7) n(n + 11 - < Sp(z) nln + - 


Here and in the following, v denotes (n+ 2)/(n + 1). 


and 
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Corollary 6.2. If A and B are hyperspheres of radii r and R (r < R) 
with the same center at the origin, respectively, and D (AC DCB) isa 
homogeneous domain, then we have, for any section vector u and x € D, 


(6.8) 2(1 — AR/r) 4” *4) < Rp (x; u) < 2(1 — Ar/R)4"*4), 


Proof. For such a homogeneous mapping /(z) of D that A(t) = 0 holds 
for any fixed point ¢ € D, we have R,(t; u) = R(0; v), where v = D_b(t)u. 
On the other hand, from (6.5) we have 


21 vA, v)) < v) < 21 - v/A, v)). 


The Bergman kernel function k (2 Z) and the Bergman metric tensor 
T ,(z, Z) of a hypersphere A = {z}|z| <7, z= are given by 


(6.9) k (2, 2) = — 


and 


(6.10) T , (2, z) = (n+ 1)r*%(r? x E.- z*z) 


as is well known (see [14], [16]). Therefore, we have 
v) = 1/k ,(0, O)v*T (0, O)v = *2 *y 


and hence A, pit u) = ((R/r)?"*?)?, Thus we obtain (6.5). 

Remark 6.1. The holomorphic sectional curvatures of the classical 
Cartan domains are always negative as was stated before. All bounded sym- 
metric domains are homogeneous but the converse is not true for n> 4 
(E. Cartan). K. H. Look gave an example of a homogeneous but nonsymmetric 
domain D having a section u such that R,,(z; u) has a positive value, 
which is the negative solution on the Hua’s conjecture. For any homogene- 
ous domain D, which satisfies A C DC B and (R/r)4"*4 <v in Corollary 6.2, 
we have R,(z; u) <0 for any w in D. 


7. Asymptotic boundary behaviors of curvatures. Now, we shall study 
the behaviors of curvatures about a boundary point of a bounded domain D 
with a sort of convexity in C” using the domains of comparison of D. 
Definition 7.1. Let D be a domain in C”. Suppose that there exists an 
analytic change of coordinates, one-to-one in a neighborhood I" (I'D D) of 
a boundary point P € OD, so that, with respect to this change of coordinates, 
D—A, P— Q={0} (Q € AA) and 
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(7.1) +2, >z*z+ o(z*z)} 


in the neighborhood of Q = {0}. Then A and also the original domain D are 
said to be strictly pseudoconvex globally representable (simply SPCGR) at 
Q and also at P, respectively. We call the new coordinates ‘‘normal’’ co- 
ordinates and the analytic hypersurface z, = 0 (with respect to the normal 
coordinates) is called the normal analytic hypersurface (simply NAH) [4], 
[9]. 

= {z|¢(z, 2) <0, € C?-class in a neighborhood of D, grad (¢) 
#0 on OD} in C” is a strictly pseudoconvex domain in the sense of Levi 
at a point = {0} € OD, i.e., satisfies L(¢(Q)) = > 0 
when (0¢(Q)/dz)z = 0 and z # 0, then by the Taylor’s expansion of ¢ at 
Q = {0} and by suitable changes of coordinates (properly affine in C” and 
biholomorphic in a neighborhood of D), we have the image domain of the 
type of (7.1) (see [9, Theorem 3.5.1 and its proof]). Therefore, any strictly 
pseudoconvex domain (in the sense of Levi) with one-to-one ‘‘normal’’ ana- 
lytic change of coordinates is a SPCGR domain. If D is a SPCGR domain, 
for the sake of estimates on curvatures, we can use A in (7.1) instead of 
D from the beginning, since curvatures are biholomorphically invariant. 

The hypersphere 


(7.2) Rs = + > & (-1<8<1): real constant number} 


is biholomorphically equivalent to the unit hypersphere E = {z||z| < 1} under 
the transformation 


(7.3) Ts: z= (1+ 6)¢-(1,0,..., 0)". 


B. L. Chalmers [4] has given the domains of comparison R® pr and 
(e > 0) for a strictly (p, g) pseudoconvex globally do- 
main D with the normal analytic hypersurface b = {¢|¢, = 0} lying entirely 
outside D. In the following, we shall treat a strictly (1, 2) pseudoconvex 
(usual pseudoconvex) globally representable domain (7.1) with the normal 
analytic hypersurface / lying entirely outside itself, which is called a 
SPCGR-NAH domain at Q. 


Ro and are equivalent to the hypersphere R_, and R, (see 


-€ 
(7.2)) under biholomorphic mappings 


2, = + (B - - al,)s 
(7.4) 
Ty 
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and 
W's + (a’+ BSS, 


(7.5) k=2, 


respectively. In particular, for sufficiently large numbers a, B, a’ and f’, 
we have 


(7.6) CACR, 


where A denotes a SPCGR-NAH domain at Q = {0} [4]. 

Definition 7.2. We shall write lim? 9; or sometimes simply lim“, to 
indicate a limit is being taken as ¢ — 0 in the set 0<a<Re(C,)/|¢| (a: 
positive constant number) and say ¢ — 0 via an A-approach after Chalmers 


[4]. 
Lemma 7.1. For a hypersphere Rs (0<85<1) we have 


and for any constant nonzero vector u = (u yo eees ut 


(n + 1)|w for u, #0, 


(n + 1)(1 + 5)|ul? for u,=0. 


Proof. Let E bea unit disc in C”. Since k pl Z) = nl/n™(1 -— z*z)"*! 


(6.9) and =k Z)\J = kp lz, + 5)?” for (7.3); then we 


have 


where 1 -z*z =(1+ 8). A; and A; = ¢, + (1+ 5)|Z|*. Noting that 
lim yA_ /A, = 1, we obtain (7.7). 

Let us set z = U(z) (p, 0,. ., 0)7, where U(z) = U(z(Z)) denotes a 
unitary matrix and p (p>0) > 1 “(for z —(-1, 0,..., 0)") is equivalent 
to under (7.3). If we set U*(z)u = U*(2(2))usve= 
and lim4y = V9 = (v9, 0°)", then we have |v| = = |u| and vt 
because z*u=(p, 0,..., 0)U*(z)u = v9 and 


z*u={(1+ -(1, 0,.... Ou=(1+ 
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for an A-approach. Further, we have, from (6.10) and Tald 2) = 
(D,z)*Tp(z, 2)Dzz, 


and thus 


=(n+ 1)P,/A%, = lv, |? +(1+ 5A, >> |v,|?. 


Since we easily have lim? oP = \u,|? and thus (7.8) for u, # 0. 
If u, = 0, we have 


lim4 P + Z,) = (1+ 8) [v9]? = (1+ dul’, 
i=2 


because we have z*u = pv, =(1+ - u,=(1+ for u, = 0, 
and hence 


2 


|(1+8) Su/p| + (1+ OC, + 


i=2 i=2 
= (1+ lvl? + fg, + 
i=2 


follows from 


(1+ 8) cu /p + XC, + 0 
i=2 


and (1 + 6)7|¢|7 27, + é) — 0 for an A-approach. Now, noting 
(7.7), lim“A_/A, = 1 and lim4 A, /(¢, + ¢,) = 1, we obtain (7.8) for u, = 0. 


Lemma 7.2. Setting ha = A and RB = B, we have 


(7.9) = D/k 2) = + d/- 


and for any constant nonzero vector u= (u prt u)T 
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lim’ 2) = Lu" Qu/k Qu*T Su 
—0 —0 


(7.10) {11+ )/(1-}"-! for u, #0, 
for u, =0, 


where ¢ denotes an arbitrary constant number in the interval (0, 1). 


Proof. By the relative invariancies of k, and Tp, under BH(D), it 
suffices to prove that (7.9) and (7.10) for R, and R_, in place of A and 
B are shown, respectively, since we have d¢/dz + E and J ,)| —1 
for each mapping (7.4) or (7.5) via an A-approach. Therefore, (7.9) and 
(7.10) are obtained by Lemma 7.1. 


Theorem 7.1. Let D be a bounded SPCGR-NAH domain at Q; then we 


have, for any constant nonzero vector u = (u,, see ud", 


(7.11) lim“ R u) = -2/(n + 1) 
z—Q 


(cf. Bergman [3] for n= 1, Fuks [7] for n = 2), 


(7.12) u) = -1 
z—Q 


(cf. Fuks [8] for n= 2) and 
(7.13) =-n. 


Proof. Using Corollary 6.1, Lemma 7.2, (5.11) and (5.17), we conclude 
(7.11), (7.12) and (7.13), since R%8, RO'S, R_, 


ically equivalent to the unit hypersphere and ¢ can be taken as sinall as we 


and R, are biholomorph- 


need by taking sufficiently large numbers a, B, a‘ and B’. O 

Now, we turn to compose another sort of domains of comparison, which 
is an immediate extension of domains of comparison due to Bergman for 
n= 1 [3, p. 38]. 

The set U(r) = {z||z, - r|? + 27_,|z,|? r: positive constant} and 
B(r) = {z||z, + r: positive constant} are biholomorphic- 
ally equivalent to the unit hypersphere E under the mappings 


(7.14) 


and 


(7.15) z= /(C,+7)-(1, 
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whose Jacobian determinants tend to r~” and —r~” for € —+0, respec- 
tively. B(r) is similar to a Siegel domain of the second kind. If we con- 
sider the sections U(r; t) and B(R; t) restricted by the counter surface 

= rt (0<t< 1), we have 


Ulr; = C BR; = ES + > VR? + 


and thus U(r) C B(R) and U(r) M AB(R) = {0} for R>r. 
By the same procedure in the proof of Lemmas 7,1 and 7.2, we have the 
following Lemma 7.3 and Theorem 7.2. 


Lemma 7.3. If R>r, we have, for n> 1, 


and for any constant nonzero vector u = (u prt — 


A) (2) A)(2) (2) 


for u, #0, 
(R/r)” for u,=0. 


Theorem 7.2. Let D be a bounded domain which has domains U(r) and 
Bir) (U(r) CD C B(r)) of comparison, then we have the same results as in 
Theorem 7.1. 


Example 7.1. (i) Let H be a Hartogs domain (complete multicircular 
domain with center at (¥(0), 0)7) {z||z, — ¥0)| < |z,| <7, 7>0, 
Wp) € C?-class and > 0, = 0, W"(0) < O}. Set H(z, Z) = 
v(0)|? — (H = < 0}). Then we have the Levi determinant 
L(¥) = -W(0)A'(0), where A(p”) = and A’(0) denotes dA(x)/dx|, 
Since A’(0) = W(0)w"(0) <0, then H is strictly pseudoconvex at 0. As H is 
expressed as 


felz, + 2, > (lz,]? - + ofz|7h 


(about the origin), H is a SPCGR-NAH domain at 0, Therefore, Theorem 7.1 
holds in this case, i.e., lim*R,,(z; u) = - 2/3, lim“C,,(z; u) =-1 and 
lim’ S,,(z) = -2. 
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(ii) Let us set H’ = {z||z, - y(0)| < |z,| <7, > 0, W(p) 
(0 < p-< 1) is a decreasing real valued continuous function which satisfies 


W(0) a + Va? - < Wp) < W(0) + Va? + p? and Y0)>a>r}. Then 
has the domains of comparison: U(a) = {z||z, - a\? + |z,| 2 and 
B(a) = {z||z, + al? >a? + |z,|7}, since -a+ p? < Wp) and 


Va? + p?+ Wp) < Y(0) + imply U(a) CH’ and C Bla), respectively, 
and QU(a) M AB(a) MN GH’ = {0} is evident. Hence from Theorem 7.2 we have 
the same results as in (i). 


Theorem 7.3. If A = U(r) and B = U(R) (or B = B(R)) are domains of 
comparison such that ACD CB and 0A N OB OD ={0} for r<R, then 


we have, for any nonzero vector u = (u pete wu)", 


(7.18) < u) < 21 Ar/R)*"4, 


and 
(7.20) nln + lim“ < nln + Ar/R)*- 
Proof. From Lemma 7.3 and Corollary 6.1, we have the results. 
8. On the Ricci scalar curvature. 


Theorem 8.1. In a bounded domain D we consider the quantity 
Ip, Z)= Ib Z) = det (RE (2, 2) x Tp(z, (see (4.22). 


(i) For p> (n+ 1)/n, which is the case that the metric dst = = ds? 1) 
can be defined (see Corollary 4,2), it — that A log Ip,» rs z)>0 
for z€D and there is no fixed point z° € D such that ae (z, Z) < 
Ip, p(z° , 2°) for z € D, where A denotes the Laplace-Beltrami ionien 
Sp T5'DzD.. 

(ii) 1 } exists a maximal point z° € D such that Jp.» (z, Z)< 
Ip o , Z°) for z € D, then p must be smaller than (n+ N/m 


Proof. Since $,(z) < n(n + 1) holds for a bounded domain D, 


A log Jn SpiT5 p - = pn? —S,(z) > pn? nln + 1)>0 
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for p >(n+ 1)/n. If there exists a point z° € D such that Ip.» (z, Z)< 

Ip rox , Z°) for z € D, then by the theorem of E. Hopf (see (33) we obtain 
Ip,» = = constant. Hence - )=0 for z € D follows and thus 
S,(z) = pn? > n(n +1) for p> (n+ 1)/n, which is contradictory to (5.9). 
The proof of (ii) is clear. 

Remark 8.1. [12, Theorem 3.10] says that in a bounded domain D, if 
there exists z? € D such that Jp 2< Jp(=*. 2°) for z € D, where Ip® 
det T, (= Ip then we have J,(z, Z) = constant and S,(z) = 
n(n + 1). But this conclusion contradicts (5.9). Therefore, it seems to 
be faulty. This is also an impossible case of Theorem 8.1(i) for p = (n+ 1)/n. 

For p = -—1/n, we have Ip,-1/n = 9 Tp/kp = 1X2, Z) which is a 
biholomorphically absolute invariant (see (4.13)). Thus the following theo- 
rem is an extension of [12, Theorem 3.9], which is obtained immediately by 
setting p =-—1/n in Theorem 8.1. 


Theorem 8.2. In a bounded domain D, let S,(z)> sq (resp. S,(z) < s,) 
for z € D, where sy is such a constant number that s.<nln+ 1). If fora 
real number p<s on? (resp. p>s o/””) | (z, Z) > Ip pe , 2°) (resp. 

Ip 2)<Jp , 2°)) in D holds for a fixed point z° € D, then we 
have S,(z) =s, in D. 


Proof. If >So for z € D and p< s,/n’, we have A log Ip, z) 
= pn?-S, (z) < pn? <0 for z € D. Therefore, if Jp, Z)> 
Ip (z°,-Z°) holds for z € D, then from the — of E. Hopf we obtain 
Jo.» “ts Z) = constant in D and thus S,(z) = pn?< So: On the other hand, 
> S, holds from the hypothesis. "Then we S = Sq in D. 


Theorem 8.3. In a bounded homogeneous domain D, if J, pi Z)> 
Ip, , 2°) (resp. Ip Z) (z°, 2°)) holds in D, then we have 
Z) = constant in D when only when p=-1M, i.e., Z)= 
Xz, Z) (see (4.13)). 


Proof. From (5.11) we have S p\z) =-. Therefore, if Ip, pi Z) = 
constant, we have A log (z, 3). = pn? and thus p=-1/n. On 
the other hand, if p =-1/n, we have A log Jp ,(z, 2)=0 in D. Using the 
hypothesis and the theorem of Hopf, we obtain J D, ACs Z) = constant, 

Example 8.1. In the case of the first type R(I) of the classical Cartan 
domains, which are homogeneous domains, we have 


Z) = det T = (m+ n)™"/V det - 
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‘(dim R(I) = mn), where V denotes the Euclidean volume of R(I). Therefore, 


Jra p(s Z) = constant = (m + n)™"/V holds when and only when p = -—1/mn 
(see [16]). 


Theorem 8.4. Let D be a bounded domain in C*, whose Levi-expres- 
sion L(g) (f € C?-class) is positive at every point on D and let 
Xz, =) = det T p Z)/k p Z) be nonconstant. If there exists a point 
z° € D such that 2°) > 9n?/2 (resp. \z°, < 92/2), then 
S,(z) cannot be bounded by -2 from above (resp. below). 


Proof. In a bounded homogeneous domain G, e z, Z) = constant in 
G. Therefore, the domain D mentioned here is a nonhomogeneous domain. 
By the result of Bergman [3], 1X2, Z) must assume its maximum (or min- 
imum) in D with L(¢) > 0. If there exists a point z° € D such that 
m0 \z°, Z°) > 9n?/2, I,,(z, Z) must have its maximum in D. In this case, if 
A log ih Xz, Z)=-2- S,(z) > 0 in D, we have, by the theorem of Hopf, 
m \z, Z) = constant in D. This is a contradiction. Therefore, S p) can- 
not be bounded by —2 from above. 


9. Reproducing kernel functions of subspaces. Recently, B. L. Chal- 
mers [5] has shown that the Riesz representation of any bounded linear 
functional in a Hilbert space with kernel function is obtained by operating 
with the linear functional on the kernel function itself and that, using this 
representation, one can display, in terms of the kernel function of the orig- 
inal space, the kernel function of any closed subspace defined as the inter- 
section of the null spaces of at most countably many bounded linear func- 
tionals. In [5] he gives the following 


Proposition 9.1. Let k,(z, @) be the reproducing kernel function of a 
bounded domain D and Ln) = (c,, coos £ be any bounded linear func- 
tionals with respect to z in D which are linearly independent. Then the 
kernel function of a subspace ={fe f= K(m) = (0, ..., 0} 


is given by 


w), LF w) 


Ry @) = det 


(9.1) 


(m)~(m) 
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The kernel function k p\ @) has interesting minimalities as is well 
known (see (3.12)). We shall give another expression of ky mi @) = 
k tz, @) as a minimizing function and show a sort of minimality of it by 
making use of the general minimum problem for Q(z, Z) = Q(z) = kp(z, w). 


Theorem 9.1. For any fixed point w € D, under the additional condi- 
tion O(z, Z) = Q(z) = kp(z @) and | = K(m) = (0,..., 0), we have the 


minimizing function 


m) — yK(m) 
where = op and w) = w) (3.3). 
The function coincides with the kernel function 


k_(z, € mP) a equals the minimum value at (3.4) 
m D 


with K(m) = he 0). Further (w, w) = k holds. 


Proof. In Theorem 3.1 if we set Q(z, Z) = k)(z, w) € £7(D) (w: fixed) 
and a = K(m) = (0), we have, from (3.3), 


Mr w) = 1B - BO )- 34, (2) 
where B= Day = fp bp pnw). Noting 


= k,(z, @), we have (9.2). 
Since, for any /(z) € £70 D), 


follows from the Riesz’s theorem, then we have 


wo, = Do, + 0= /(w), 


which shows that Mi w) has the reproducing property in 
further, w) with k (z, by means of (9.1), since, in 


general, det (4 B)(det D)~! = a= BD~'C holds for a scalar a and a non- 
singular matrix D. Last parts of the theorem are easily obtained by (3.3) 
and (3.4). 

Remark 9.1. If we set 
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k r(k 


1 n 
with &7_,7(k, i) = r(k) > 0, we have another expression of Example 1.5 [5]. 


10. Fundamental theorem (I) of K. H. Look. In this section we shall 
give a neat but essentially equivalent proof of the fundamental theorem (I) 
given by K. H. Look [14] and an extension of this theorem using the mini- 
mum problem. 


Proposition 10.1 (Fundamental theorem of Look). Let D be a bounded 
schlicht domain and {(z) = (f(z), ..-; f(z)" be any holomorphic mapping 
with the condition |{(z)| <M in D, then we have 


(10.1) (df(z)/dz)*(df(z)/dz) < 2), ze D, 
and 
(10.2) [J {2)|? <M?” det T(z, 2), € D. 
Proof. Let MECNz, t) be the minimizing function with the condition 
Q(z, z)= 0 and K(2)=(A,, A,), and F(z) be a holomorphic mapping 


ky (z, T)f(z) € L7(D), then by (3.8), (3.9) and the Riesz’s theorem for 
bounded linear functionals, we have 


(10.3) Fl2) x MKO*(z, ta, = (WAT - - AY, 


where /,(t) = D_f(t) and T= Setting (A,, A,) = (0, Tp(t, 7) 
(this is possible since /(z) = T,,(¢, Z)z belongs to Loo,7)))s we have 


= T* My "2, t)x F*(z)w, F(z) x My” *(z, 


For an arbitrary mx 1 vector u, we have, by the Schwarz inequality, 


OF OF, * 
u* T f, Mp "Mp w,Tu) 


< kM2u*T(kT)~!Tu = Tu. 
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This shows (10.1) and therefore (10.2). 


Theorem 10.1. Under the same hypothesis as in Proposition 10.1, we have 


(10.4) + 5 Mz, < M? x E, 
and 
If {(z) belongs to BH(D), we have 


Proof. In (10.3), setting F(z) = k,,(z, 7)/(z), which belongs to £(d), 
and (A , A,) = (F(t), dF(t)/dz), we have 


F(z) x 24 (2, tho, = + 


where k=k,(t, 7). By a way similar to that of the proof‘of Proposition 10.1, 
we obtain 


By the diagonalization of Hermitian matrices, we have (10.4) and thus (10.5) 
(cf. (10.1) and (10.2)). 

Let us assume that /(z) belongs to BH(D) in (10.4). Since ie < 
M?x {{*/M?) follows from (10.4), we obtain < 
M°T by taking the inverse on both sides of the above. If A and B are pos- 
itive definite Hermitian matrices and satisfy A < B, we have AW} > B-' 
because, from a known theorem of matrices, A and B are simultaneously 
brought to diagonal matrices with positive diagonal elements by operating 
suitable regular matrices P* and P oneach of A and B as P*AP and 
P™BP. Noting that - + {f*/(M2 = |f|?), we get (10.6), 
which is an extension of (10.1) for {(z) € BH(D). 
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UNIQUENESS AND a-CAPACITY ON THE GROUP 2%’) 
BY 


WILLIAM R. WADE 


ABSTRACT. We introduce a class of Walsh series + for each 
0 <a<l1 and show that a necessary and sufficient condition that a 
closed set E & 2® be a set of uniqueness for J, is that the ocapac- 
ity of E be zero. 


1. Introduction. A Walsh series S = 5-07" is said to belong to the 
class @ if 


(1) lim =0 for all x€ 2%; 


N-1 
Sx) = aw (x) 
k=0 
for N=0,1,.... 
Let 0 <a <1 and for each positive integer k set [k] = 2” where n is 
the nonnegative integer determined by 2” <k < 2*l. A Walsh series S = 
is said to belong to the class if 


k=1 
The Walsh series S is said to belong to the class 8 if in addition to (2) 
there exist integers 0 <n, <n, <-+++ such that 


(3) S >0 ae. 


If O0<a<1 then @, since by Schwarz’s inequality 
2"—1 
k= 
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Let B be a certain class of Walsh series. A subset E of the group 2® 
is said to be a set of uniqueness for B if S ¢ B and lim, 1105 2n(*) = 0 for 
x € 2°~ E imply that S is the zero series. 


For each Borel set E € 2® let I(E) denote the set of all nonnegative 
Borel measures concentrated on E with total variation 1. Let O<a<l. 
We associate with each measure p € MME) a potential function 


(4) = f Kale 


where K, is the nonnegative, lower semicontinuous, integrable function {x} 
introduced in [6]. Let 


W,(E) = inf{WA(E): pe MED}, 
where for each p € MME), 


Then E is said to be of a-capacity zero if W{E) = +0. 

Crittenden and Shapiro [3] have shown that a Borel set E € 2® is a set 
of uniqueness for @ if and only if E is countable. For each a € (0, 1) we 
shall show that a closed set E € 2® is a set of uniqueness for =. if and 
only if the a-capacity of E is zero. Fora large class of null Walsh series 
which is contained in > see [8]. 

This author is indebted to Professor Victor L. Shapiro who first posed 
this problem in 1964 with a in place of - al The analysis presented here 
would also solve the original problem if a group 2 analogue of Frostman’s 
maximal principle were known. For this connection and a theorem concerning 


the trigonometric analogue of this problem see [1]. 


2. Fundamental lemmas. We begin this section quoting two results which 
are straightforward modifications of Theorem 2.9 and Lemma 3.2 in [6]. 


Lemma 1. Let E,, E,,... be a nested sequence of closed subsets of 


2® such that E=()\*_,E, is a set of a-capacity zero. Then lim, _.W(E,) 


n-—oo a 
=+co, 
Lemma 2. Given a set E © 2° of positive a-capacity there is a meas- 
ure p € IME) such that its potential function is in L™(2%) and satisfies 
(6) > 


for almost every x € E. 
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The first lemma we prove is 


Lemma 3. If S = 20%, € @ and c, d are dyadic rationals in (0, 1), 
then there is a Walsh series T € G and an integer N such that n>N im- 
plies 
(7) = for x d)- 
and 


=0 for x¢le, d). 


To establish this result we define 7 °k for each pair j, k of nonnega- 
tive integers by Let P(x) = be the Walsh poly- 
nomial which is equal to 1 for x € [c, d) and equal to 0 elsewhere. Let 
T = 2) where 


M 
j=0 


Then by Sneider [11, p. 285], 


(9) = P(x)S x € 2”, 


when 2” >M. In particular, the choice of P forces T to have the desired 
properties. 

Fine [4] has shown that a Walsh series S which converges to zero on 
an interval | with dyadic rational endpoints necessarily converges uniformly 


on I. It turns out that the 2”th partial sums of S eventually vanish on I. 
In fact: 


Lemma 4. Let F be aclosed subset of (0, 1] and S= {07M e @. 
Suppose further that lim, _Son(x)=0 ae. x €[0, 1] ~ F and that 
lim sup, 2n(*)| < for all but countably many x € (0, 1]~ F. Then for 
any interval (c, d) C [0, 1]~ F with dyadic rational endpoints there is an 
integer N such that n>N and x €(c, d) imply S,,(x)=0. 


To prove Lemma 4 let T be the Walsh series corresponding to S$ and 
(c, d) given by Lemma 3. The conclusion of Lemma 3 and the hypotheses 
of Lemma 4 show us that T is a Walsh series, belonging to G, whose 2"th 
partial sums converge to zero almost everywhere, are pointwise bounded off 
a countable set and satisfy (7) for nm greater than some integer N. T is 
necessarily the zero series by the main theorem in [12]. Hence S,,,(x) =0 
for x €(c, d) and n>M by (7). 
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3. The characterization. 


Theorem. Let a €(0, 1) and E be aclosed subset of the group 2°. 
Then a necessary and sufficient condition that E be a set of uniqueness for 


7. is that the a-capacity of E be zero. 


Necessity. Suppose the o-capacity of E is not zero. Then by definition 
there is at least one measure p € MM(E) such that WE(E) <0. Let dy, dj... 
represent the Walsh-Fourier-Stieltjes coefficients of and set = od,¥,. 
S5n(x) =0 for x 
e[0, 1]~ E since p is supported on E (3, p. 563]. Furthermore S,,, >0 
since *p and D,,>0. Hence it suffices to show 


S is not the zero series since d, = ||p|| = 1. Also, lim 


Lemma 5. Let 0<a<1, E be aclosed subset of the group 2%, and p 
e M(E). Then there is a positive constant B depending only on a such that 


(10) D WHE). B 
k=0 


where dy, dy,.+. are the Walsh-Fourier-Stieltjes coefficients of p. 


Let bo, b;,-.. represent the Walsh-Fourier coefficients of K,. Harper 
[6] has shown that there is a positive constant B depending only on a such 
that 


(11) Bb, k= 1, 2,.... 
For convenience let us define [0]°~! so that (11) holds with k = 0. 


To prove (10) we may suppose that WE(E) <o. In this case it is known 
that = Ax) d,({x). Combining this with (11) we have 


Bo! = dfx) < WHE). 


Sufficiency. Suppose E is of a-capacity zero. Let S= 2)" be 
a Walsh series belonging to J* such that lim, 2n(*) =0 for x €2°~ 
We must show a, =0 for R=0,1,... . 

We first show that a) =0. Let A: 2” [0, 1] be defined by 
)= DP 2 Since A is continuous [4] and E is compact, 
ME) is necessarily closed in [0, 1]. Let [0, 1] ~ A(E) = U1 |, where 
I, 15,+++ is a sequence of open intervals with dyadic rational endpoints. 
Finally define a sequence’of closed sets E, 2 E,>--++ in the group 2® by 
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N 
i) 
k=1 


Now as a Walsh series on [0, 1], lim, _.52n{*) =0 for x ¢ A(E). Hence N 
applications of Lemma 4 allow us to conclude that for n sufficiently large, 


Son(x) =0 for x € 1 I,. As a series on the group 2%, this means 


(12) =0 for x€ Ey: 


Let 0 <n, <n, satisfy (3). Since a) = fwS (x) dx we conclude 
that a, >0. By (12), 


(13) lad = Ji, S 


for j sufficiently large. Use Lemma 2 to choose an equilibrium measure p 


€ IME) satisfying (6). Then yf (13) and (3) 


for j sufficiently large. Hence by (12) and Parseval we have 
a,b,d, 

for j sufficiently large, where 4 ive .++ are the Walsh-Fourier coefficients 
of K, and dp, d;,... are the Walsh-Fourier-Stieltjes coefficients of p. Ap- 
plying Schwarz’s inequality we have 

"74 


k=0 k=0 
But S € - so by (11) and Lemma 5 we conclude that 
(14) ae < const 


Observe that A~! oA(E) = Now lo \(E) ~ E is at most count- 
able and the a-capacity of Ei ; zero, so the a-capacity of 472 ; Ey must 
also be zero. Hence by Lemma 1, limy __..W,(Ey) = +e, which by (14) implies 
that a, = 0. 


For future reference, let us call what we have just proved a lemma. 


Lemma 6. Let S € - pe and E be aclosed set of a-capacity zero. If 


lim 205 2n(x) =0 for x € 2°~ E, then the constant term of S$ is zero, 
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Suppose for some m>0O that a, =0 for k=0,1,..., 2” —1. We shall 
show that 


(15) a,=0 for k= 2”, 2"+1,..., 2"*! -1 


thereby finishing the proof of the Theorem by induction. 
To prove (15) fix an integer / €[2”, 2”*") and set 


(16) P(x) = D (1. 2"+! x), 


It is easy to see that P(x) = S2"*!=-1 B™ w(x) where BS” = #1 and that 
y j=0 j i i 
the matrix 


A = (pi: ju 2, ..., and 1) 


is nonsingular. For a similar result concerning Haar polynomials see [7]. 
Now set y, where 


j=0 


A routine computation shows that T € > As in the proof of Lemma 3, 
To = P(x)S 2% 


for n sufficiently large. In particular lim, T ,n(x) =0 for x € 2° E, 
and T_,A(x)>0 a.e., j7=1,2,.... Hence y, =0 by Lemma 6, By the in- 
ductive hypotheses and (17) we conclude 0 = Sar -— oi a, This identity 


holds for each / = 2”, 2" +1,...,2"*!~1 so we finally arrive at the ma- 


trix equation 


a 
gm+1_} 


om 


Since the matrix A is nonsingular (15) is established as required. 
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ABSTRACT. We provide a number of bounds of the form |y| s 
O.exp(—a]x|%)), a >1, for L? -eigenfunctions y of with « 
rapidly as |x|—+ Our strongest results assert that if > ex?™ 


near infinity, then |y(x)| exp(—(c — + *h, and if |V(x)| 


<cx?™ near infinity, then for the ground state eigenfunction, 2, 2(x) > 


E, exp(—(c + +1), 


1. Introduction. This is the last in our series of papers [19], [20] on 
pointwise bounds for L?-eigenfunctions for Schrédinger operators — A + V on 
L?(R”). We have been partly motivated by a desire to extend and exploit 
the recent elegant techniques of O’Conner [15] and Combes-Thomas [3]. In 
(I) of this series, we considered the case V = 2ViC; - r,) with V —0 


as x —» co and found exponential bounds D,exp(- b|r|) but only for b smaller 
than some optimal bo; in (I) of this series, we considered the case where V 
was bounded below and V — o as r — o and found exponential falloff for 
every 6. In this paper, we wish to examine the case where V not only goes 
to infinity as r — o but at least as fast as some power r?™_ Not surprising- 
ly, we will find that there is then falloff of O(exp(- cr™)) for some a > 1. 

The relation between a and 7 is simple and is ‘‘predicted’’ by the fol- 
lowing heuristic argument of WKB type [14]: If Ay = Wy and we write p = 
exp(— 4), we find that obeys 


(grad b)? (Ab) = W. 


If the variations of are primarily radial we have (dh/dry? — r~?(d/dr) « 
(r?(dh/dr)) = W. If W— 0, then Ob/dr — © so that the second derivate 
makes a small contribution. Thus ) ~ + swi/2 dr, i.e. 
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~ exp (- f dr). 


If W=7r2" E, we see that swi/2 ise. we expect to find that = m+ 1, 

For the case n= 1, it is often possible to use ordinary differential 
equation methods to control the falloff of eigenfunctions. For example, one 
has the following theorem of Hsieh-Sibuya [10] (see also the appendix by 
Dicke in [18]): 


Theorem l. Let w € C?(R) be a nonzero function obeying 
(1) + Vb = Ep 


with 


V(x) =a, x? a 


> 0. 


2m 


Then, for suitable c,, either: 


0? 
(a) as x —+ + inwhich case (m+ 1)(In 
— 1 as x — », or 
(b) co W(x) Oas x — + in which case (m+ 1)(In co 


—1as x — 


The proof of Theorem 1 depends on the explicit construction of two 
independent solutions of (1) and thereby of all solutions. When 2 > 1, we 
have a partial differential equation and, in general, one cannot use a method 
listing all solutions. For later reference, we do note that in the case where 
V on R” is centrally symmetric, one can separate variables in spherical co- 
ordinates and employ Theorem 1 to give some information. 

We attack the problem of bounds on eigenfunctions of 
(2) + Vb = Ew 
by two'methods. The first follows the approach of Combes-Thomas [3] and 
our earlier work [19], [20] and is discussed in $$2—4. We will be able to 
discuss fairly general V but our results wili not always be as strong as 
might be hoped for. The second approach, found in $§5, 6 is completely 
independent of $$2-4 although it does depend on a result of Combes-Thomas 
type we proved in [20]. The V’s we are able to discuss are somewhat re- 
stricted and so we restrict ourselves to multidimensional anharmonic oscil- 
lators, i.e. V will be a polynomial in x,,-.-,%*, of degree 2m with the 
property that the leading term be strictly positive on the unit sphere (so that 
for X near %, < Vix)< c\x|?"). Our strongest result is ($6) 


Theorem 2. Let w be an L?-eigenfunction for—A+V. Suppose that V 
is C™ and for some c > 0, @: 


(3) V(x) > - d. 
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Then for any €>0 there is a D, with 
(4) |W(x)| < D, exp(-V(c 


Next suppose that & is the “‘ground state’’ eigenfunction, i.e. is the 
eigenfunction associated to the lowest eigenvalue, E,, of -A+V. Then it 
is known (see, e.g. [22]) that E 9 iS a nondegenerate eigenvalue and that w 
can be chosen to be a.e. strictly positive. For this ground state eigenfunc- 
tion we have ($6) 


Theorem 3. Let y be the ground state eigenfunction for -A+V. 
Suppose that V is C™, V — ~ at « and for some e > 0, /: 


(5) V(x) < elx|?™ + f. 


Then, for any €> 0, there is a G, with 


(6) W(x) > G, exp(-Vle + 


In particular, y is strictly positive. 


We close this introduction with a series of remarks about Theorems 2 and 3. 

1. The proofs of Theorems 2 and 3 rely on Theorem 1 and a simple 
comparison argument ($5). The comparison argument depends on certain 
methods from classical potential theory; we have borrowed the idea of using 
these potential theory methods from Lieb-Simon [11] who is turn were moti- 
vated in part by some remarks of Teller [23]. 

2. Our interest in Theorem 3 and in the more general problem of sharp 
bounds on eigenfunctions of multidimensional anharmonic oscillators comes 
in part from recent work of Eckmann [5] and J. Rosen [17] generalizing L. 
Gross’ logarithmic Sobolev inequalities [8]. We discuss the use of Theorem 
3 to generalizing Rosen’s results in $7. 

3. Still another method for controlling falloff of eigenfunctions for an- 
harmonic oscillators is to look at the finite dimensional Lie algebra gener- 
ated by — A and V and use Lie algebraic techniques on eigenfunctions 
treated as analytic vectors. This approach has been advocated and 
developed by Goodman [6], [7] and Gunderson [9]. 


2. L? bounds of WKB type. 


Theorem 4. Let V=V,-V_ with V,>0, V, € V_ L9(R”)+ 
L™(R") with q=1 ifn=1,q>1 if n=2 and q=n/2 if n>3 (so that V_ is 
a form bounded perturbation of — A with form bound 0), Let H=-A+V 
defined as a sum of quadratic forms, Let wy be an eigenfunction for H with 


eigenvalue E in the discrete spectrum for H. Suppose W is a real-valued 
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absolutely continuous function on R” with 


(7) |grad c,(H 


for suitable c,,c,. Then, for some a >0, 


(8) exp(aW(x))y(x) L°(R”). 


Remarks. 1. In most applications, V, — © at « so H has compact 
resolvent by Rellich’s criterion. In such situations, E is automatically in 
the discrete spectrum. 

2. As a particular example, suppose V_ = 0 and let V(r) = = inf),.| . VV). 
Then we can take W(r)= f lV) V/2 dr, thereby obtaining L?-bounds on w 
of the usual WKB form. ™ 

3. Our proof is a fairly direct modification of the idea of Combes- 
Thomas [3] which in turn is motivated by [1], [2] (see also [21]). 

Proof. For real B, let U(B) be the unitary operator of multiplication by 
exp(iBW(x)). (8) is easily seen to be equivalent to the statement that w be 
an analytic vector for U(B) in the sense of Nelson. For B real, let 


H(B) = U(B)HU(B)~*. 
Then 


(9) H(B) =(p - B grad W)7+V 
where p= grad. Thus 


H(B) = H + B*( grad W)? — Pl p( grad W) + (grad W)p). 

Now, note the following estimates for ¢ € Q(H) = Q(A) NQWV,): 

(10a) (},(grad W)*¢) < c,(¢, (H + 

(10b) 2 Re(pd, (grad Wd) < Apd, (grad W)?4)” < c3(, (H + c,)) 


where we have used (7) and the operator estimate p? < p? + (p? -2V_+ 
c 3S 20" +V)+ cs which follows from the fact that V_ is a form perturba- 
of p? with bound 0. 

Choose d with H+ d> 1. It follows from (10(a)(b)) that for complex B 
sufficiently small, say |B| < B, (9') defines a closed sectorial form on Q(H). 
It follows that for |8| < B, H(B) is an analytic family of type (B) [12]. 

By analytic perturbation theory, it follows that for |8| < By, H(8) has 
only discrete eigenvalues E ,(8),..., E,(8) in its spectrum near E and 
that the E (8) are analytic. Since H(8) is unitarily equivalent to H for B 
real, E (8) = E for B real and thus, by analyticity for all B with |B| < By. 
Let 
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so that P(8) is the projection onto the eigenvectors for H(B) with eigen- 
value E. Since U(a) P(B) U(a)~! = P(B + a) for a real with |B+a|< By 
a lemma of O’Connor [15] assures us that w € Ran P(0) is an analytic 
vector for U(a). O 


3. Pointwise bounds, m< 1. We now wish to turn the L?-bounds, 
yw € D(exp(aW(x))), into pointwise bounds of the form 
(11) |WAx)| < A exp(-—a'W(x)). 


We consider the case W(x) = |x|"*1. In this section, we will see how to 
use our method from [20] to obtain pointwise bounds in case V_ = 0 and 
m<1. We note that our method in [20] was motivated by an idea of Davies 
[4]. We exploit smoothing properties of exp(tA): 


Lemma 3.1. Let € D(exp(a|x|"*1)) for some a > 0 and 0< m< 1. 
Then for all t sufficiently small, there is an A and C (t dependent) so that 


< C exp(-A|x|*"). 
Proof. We first note that 
1+ |x -y|? + |y|™*? > |x - + 
so that 


exp(—a|x y|7) exp(—aly|*1) < exp(1 2-"~ 4a|x|™*). 
Thus 


fexpl-(a + 1)|x - dy 
< fexp(-(a + y|? dy 


<c exp(- 1g|x|™+1) 
since both factors in the integral are L?, On account of the explicit form 


of the kernel for e*4, the lemma is proven. O 


Theorem 5. Let V € (L?),. with 


(12) a|x|?" < V(x) +B 


322 BARRY SIMON 


for suitable m, 0<m< 1, and suitable a, B. Let H=-—A+V defined as 
a selfadjoint operator sum [13]. Let y be an eigenfunction of H. Then, for 
some y>0 and C: 


(13) |WAx)| < C exp(-y|x|"*"). 

Proof. By Rellich’s criterion, (12) implies that H has only discrete 
spectrum. Letting W(x) = |x|"*! and using (12) and Theorem 4, we see 
that & € D(exp(a|x|”* 1)) for some a > 0. 

Let V, be a sequence of bounded functions with V,(x)— B converging 
montonically upward to V. Then using the fact that CO is a common core 
[13], it is easy to see that H, =-4+V, converges to H in strong resol- 


vent sense [12], [16] as k — ~ so that exp(- tH), — exp(— tH) strongly as 
ta 


is positivity preserving and e’” > e > 0: 


k —+ 0, Moreover, since 
0 < (en < etdethig| 


for all 6 € L?. By the Trotter product formula [16], 


O<e < 
so by the convergence result: 
0< < 4), 
Thus for any eigenfunctions w with Hy = Ey: 
\w| = et < et +A 
By the lemma, and the fact noted above that || € D(exp(a|x|"*!)) we 


obtain (13). O 


4. Pointwise bounds, m > 1. When m > 1, we are not able to use the 
method of the last section to obtain pointwise bounds. Instead, we rely on 
Sobolev type estimates and therefore obtain results whose hypotheses 
depend on 7, the dimension of space. We illustrate the ideas first in the 


special case n< 3 where only minimal additional hypotheses are needed. 


Lemma 4.1. Let f(x) = a(x? + on If € L?(R”) and 
Aw € D(e!), then for any multi-index a with a < 2, D*y € D(exp{(1 - 6)/)) 
for alle>0O. In particular, Ace -©%y) € L?, 


Proof. By a simple argument, we need only prove a priori estimates for 
€Co(R”). We note first that for any 


(14) fe ivul? -- f 
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Let 8 < 1, then since eFhy*, Aw € L? and Viehy* € L?, the R.H.S. of 


(14) is finite and thus Vw « D(eFl/2), We can now apply (14) when B < 3/2 
to conclude the R.H.S. is finite so that Vir € D((3/4- €)f). Repeating the 
argument, we see that Vy € D(exp((1 - €)/)). From 


= + + [Me 
we conclude that e*/y € D(A) for B< 1 so that D*(e*/y) € L? if a] < 2. 
Since Vy € we see that D°w € D(exp((l-«)/)). 


Theorem 6. Suppose that the hypotheses of Theorem 4 hold with n< 3 
and W(x) = |x|"*1!, Suppose in addition that 


(15) |V(x)| < C, exp(C,|x|*) 
witha<m+1. Then any eigenfunction of A + V obeys 


(16) < C; exp(-C,|x|"*") 


for suitable C3 C, > 0. 


Proof. By Theorem 4, & € D(exp(a/)) for suitable a > 0 with /= 
(1 + Since Ay = Ey, Ay € (exp((a - on account of 
(15). Thus by Lemma 4.1, e%~/y € L?(R")M D(A). By a Sobolev 
estimate, e*-©%y is a bounded continuous function, so (16) holds. 0 


For general n, we need 


Lemma 4.2. Let k be a positive integer and let D*yy, A(D*W) € 
D(exp(/)) with f\x| = a(x? + for < 2k. Then D°y 
Dlexp(1 - forall and < + 1) In particular, 
A+ Del L?, 


Proof. This follows immediately from Lemma 4.1. 0 


Theorem 7. Fix n and m. Suppose the distributional derivatives D*V 
for |a| < 2[n/4 + 9/8] where [x] = greatest integer less than or equal to x) 
are locally L! obeying 


|D°V| <C, exp(-D,|x|"*!~*) 0) 


and that moreover 
V(x) > C|x|?” - D. 
Then any eigenfunction y of - A+ V obeys 
< A exp(-B|x|™*?) 
for suitable A, B> 0. 
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Proof. Similar to Theorem 6 but employing — AD“yy + D* (Vs) = ED*y 
as well as O 


5. A comparison argument. We now turn to a method of obtaining falloff 
information for eigenfunctions which is independent of and stronger than the 
results of $$2~—4 but under stronger hypotheses. As we have already stated 
in the introduction, this method is motivated by [23], [11] although the basic 
idea is fairly standard. J. M. Combes (private communication) has informed 
me that T. Kato (unpublished) has used a not dissimilar idea in the one- 
dimensional case. The basic comparison theorem is 


Theorem 8.(2) Let S be aclosed ball in R". Suppose that f, g are func- 


tions C™ in a neighborhood of R"\S, and that 
G) Al/|< all x ¢5, 
Gi) Algl > Wigl all x 
(iii) — Qas x — o, 
(iv) W(x) > V(x)> Oallx ¢S, 
(v) > le(x)| all x € OS. 
Then \f(x)| > |g(x)| all x 


Remark. (i), (ii) are intended in the sense of distributional inequalities. 
Proof. Let D = {x| |/(x)| < |g@)|} and let = |g(x)| - |/@)| on D, which 
is open. Then, on D, 
Avs > (by (i), Civ)y 
- (by Civ)) 
>0 (by xe D), 
Thus W is subharmonic on D and so takes its maximum value on OD U {oo}, 
But w — 0, at © by (iii), at points x € ODM OS by (i) and at points 
x € AS by definition. Thus 0 on D. But, by definition, > 0 
on D soD is empty. O 


6. Eigenfunctions of anharmonic oscillators. 


Lemma 6.1. For any m>0, C > 0, there exist anf and E so that 
— Af + C(x? + 1)"f = Ef with 


(17) 0< f(x) < D, exp(-(c - | + 


all x, Moreover, for suitable D'> 0 


(2) Added in proof. H. Kalf has pointed out a similar result in P. Hartman 
and A. W. Winter, Partial differential equations and a theorem of A. Kneser, Rend. 
Cir. Mat. Palermo (2) 4 (1955), 237-255. MR 18, 214. 


= 
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(17’) > D: exp(-(C + + 


Proof. Let H =—A +(x? + 1)". Choose f to be the ground state eigen- 
function for H (which exists since H has purely discrete spectrum). Then / 
is a.e. nonnegative, so by the symmetry of H, / is spherically symmetric. 
Thus / obeys a suitable second order ordinary differential equation so that 
it is impossible that f and V/ both vanish. But since { > 0 and C™ (elliptic 
regularity) / = 0 implies that V/ = 0 so f is strictly positive. 

We claim that (17) holds near infinity and so everywhere. This follows 
either by appealing to a suitable generalization of Theorem 1 (since 
[xj™~ 1/27 obeys an equation similar to 1 but with an extra C|x|~? in the 
potential) or by appealing directly to Theorem 1, using Theorem 8 and an 
argument similar to that used in Theorem 2 below. O 

We now repeat 


Theorem 2. Let V be a C™ function on R” and let g be an eigenfunction 
of -A+V. Suppose that V(x)> c|x|?" ~ d for some c,'d> 0. Then, for 
any €> 0, there isa D, with 


(18) |e(x)| < D, exp(-(c - + 
Remark. It is easy to replace C™ by C? for suitable finite p. 
Proof. Let (- A+ V)g = Eg. Given «, find with A+ (c— ¢/2)|x|?"1/ = 
~ ~ 
E gf, 0</< D exp(-(c- Let V = - W = 
V-E. Find a sphere S with V > W > 0 outside S. Since {> 0, / is bounded 


below on OS, so choose f a multiple of / with |g|< / on OS. By Kato’s in- 
equality [13] 


Alg| > Re((sgn g)Ag) = Re(W|g|) = 


Finally, we note that by the exponential falloff inequalities on g [20],g—- 
0 at «. Thus applying Theorem 8, |g| < / outside S. (18) now follows. O 

Now consider V which is C™ with V — » at «, By Rellich’s criterion, 
—A+V has compact resolvent and so a lowest eigenvalue E,- By a stan- 
dard argument [22], E 9 is simple, and the corresponding eigenvector, is 
a.e. positive. Following [23], [11] we first note 


Lemma 6.2. If w is a.e. positive, C® with - Ay = (- V + E) with V 
C™, then w& is everywhere strictly positive, 


Proof. Suppose that /(0)= 0. We will prove that w is identically zero 
near 0 violating the fact that W is a.e. positive., This will prove that w(0)4 
0 and by similar argument that 4 0 for all x. 
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Thus, suppose 0. Let c(r) = fix| ar Then c(r) 9 as 


r— 0 and 


n-1 de _ Os 
“Seter (Aw) dr 


< max (|V- Ax) dx. 


|x|<r 


Fix and let D = (|\V-E|). Then for 0<r<Ry 


< pf’ c(x) dx <(Dr) max c(x). 


OSxSr 
Since ¢(0) = 0: c(r)< (4Dr?) maxy<,<,C(*) so for 0<r<R, 
Dr?) maxy<, 
Choosing r so small that Dr? < 2andO<r< R, we see that 
MAX = 0 so that = 0 if |x| <2. 


We next repeat 


Theorem 3. Let w be the ground state eigenfunction for -A +V where 
V is C” and V— «, Suppose that V(x)< e|x|?"+s. Then for any €> 0, 
there is a G, with 


(19) Wx) > G, exp(- ye + |x|"*"m+ 


Proof. Let V =V~E and let W = (e + &/2)|x|?"+s. Let g be 
the ground state of -A + W with ground state energy E and let W=W-E. 
Pick S so that W > 7 > 0 outside S. Since f is strictly positive and C™ by 
Lemma 6.2, choose a multiple 2 of g with / > g on OS. Then {> g on R/S 
by Theorem 8. Thus, by Lemma 6.1, (19) follows. O 

When V is a polynomial, we can say much more about the eigenfunctions. 

Theorem 9, Let V be a polynomial in n variables on R” with 
C(x?™ — 1) < V(x) < d(x?” + 1) for m>1. Let be an L?-eigenfunction for 
-A+V. Then: 


(a) & is a real-analytic function and has an analytic continuation to 
the entire space C”, 


(b) For any y €R”, e€>0, 
|W x + iy)| < Cye expl-(m + (d - 


for all x € R”. 
(c) For any €> 0, there are constants E and F with 
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< E 
all z €C” with arg z, = +++ = arg z,, and |arg z,| < 7/2(m+ l)-«. 
(d) For any €> 0, there are constants G, and G, with 


\W(z)| < G, exp(-G,|z|"*) 
for all z €C” with |arg z,| < 7/4m—€,i=1,..., 2 


Remark. With a minimal amount of extra work, one should be able to 
improve (d). 

Proof. By the basic Combes-Thomas argument [3] we see that W is an 
entire analytic vector for the group {U(a)|a R”} where U(a)W(b) a). 
Thus the Fourier transform of has the property that € L? for 
alla eC”. It follows that w is an entire function, proving (a). Moreover, 
wW(- + iy) is an L}-eigenfunction of —A + V(- + iy) so the methods of $4 
(or $5) allow one to prove (b). The bounds in (c), (d) follow by similar 
arguments (and a Phragmen-Lindeléf argument to get uniform constants) but 
using the group of dilations [1], [2], [21]. For (c) we note that - B~?A + 
V(Bx) is an analytic family of operators sectorial (in the sense of [16]) so 
long as |arg B| < 7/2(m + 1) and for (d) that 


- £+ V8 
D=1 z 


is accretive if larg B,|<7/4m. 
Remark. Results related to Theorem 9 have been found by different 
methods in [9]. 


7. Supercontractive estimates a la J. Rosen. In [8], Gross considered 
the following situation. Let H=—A+V on L?(R", dx) where V is a poly- 
nomial bounded from below. Let 2 be the ground state eigenfunction for H 
and let H = H-(Q, HQ). Let dy be the probability measure 2? dx. Then H 
on L?(R”, dx”) is unitarily equivalent to G = 0-!HO on L?(R", du). G is 
a Dirichlet form in the sense that Gd) = f grad grad Eckmann 
[5], following a suggestion of Gross [8], proved a variety of estimates which 
imply that G generates a hypercontractive semigroup [22] on L?(R”, dy) in 
case n= 1 or V is central and these estimates were improved by Rosen [17] 
who proved, in particular, that e~*© is bounded from L°(R”, du) to 
L4(R”, du) for all t > 0, p, g #1, ~, again if m= 1. In Rosen’s proof 2 =1 
enters in two places. First, he uses the fact that on R, /< c(d*/dx? + 1) if 
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fe L'(R, dx), but on R” this can be replaced by f<c-A+)) if fe 
L?(R", dx), p > n/2 (n> 2). More critically, he requires that Q = e~” with 
(hy?™/™ +1 < a(V + b) if m= 4deg V. This requires a lower bound on the 
falloff of 2 which was not available to him. 

Our considerations in $6 were partially motivated by a desire to prove 
Rosen’s estimates in case n> 1 and our results there allow us to mimic 
Rosen’s proof [17] and conclude: 


Theorem 10. Let V be a polynomial on R” with a(x?™ — 1)< V(x)< 
b(x?™ + 1). Let H=-A+V,Q be its ground state, du = 0? d"x and G be 
the Dirichlet form on L?(R", du). Then: 

(i) For all f € Co (R”): 


Gi) D(G*/?) = tf € € L?; lal < 
(iii) For allt >0, p, ~» is bounded from L?(R”, du) to 
L?(R”, dy). 


Remark. By using the upper bounds we have on 2, we can show that 
the inequality in (i) fails if a factor of log (log (+--+ log, (\/I))) (j times) is 
added to the integral for any j > 0. This follows by Rosen’s arguments [17]. 
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ABSTRACT. Let H be an infinite dimensional complex Hilbert space, 
and let 8(H) (resp. C(H)) be the algebra of all bounded (resp. compact) lin- 
ear operators on H. It is well known that every T € 8(H) has a best approx- 
imation from the subspace C(H). The purpose of this paper is to study the 
uniqueness problem conceming the best approximation of a bounded linear 
operator by compact operators. Our criterion for selecting a unique represent- 
ative from the set of best approximants is that the representative should com- 
mute with T. In particular, many familiar operators are shown to have zero as 
a unique commuting best approximant. 


Introduction. Let H be an infinite dimensional complex Hilbert space, 
and let B(H) (resp. C(H)) be the algebra of all bounded (resp. compact) lin- 
ear operators on H, It is well known [4], [6] that C(H) is proximinal in Z(H), 
that is, for every T € B(H) there exists a C € C(H) such that ||T - Cll = 
dist (T, C(H)). It was shown, in [7], for arbitrary noncompact T that the set 
P(T) of best compact approximants to T has infinite dimension. From this 
proposition it can be deduced that c, viewed as a subspace of m has the 
same property. These spaces are the first ‘‘natural’’ proximinal subspaces 
known to the authors to have such a property. This phenomenon leads one to 
the question of finding a unique representative from 9(T). Thus the purpose 
of this paper is to study the uniqueness problem concerning the best approxi- 
mation of a bounded linear operator by compact operators. Our criterion for 


selecting a unique representative Cr from 9(T) is that Cr should commute 
with T. 


Now, in general, to satisfy our criterion for arbitrary T is not an easy 


task, since Lomonosov has shown [8] that any operator commuting with a 
nontrivial compact operator has a nontrivial invariant subspace. However, 
we recall from [7] that operators in the set C(H)° ={T € B(H)| ||TI| = 

dist (T, C(H))} (anticompact operators) have, by definition, a commuting best 
compact approximant, namely 0. The anticompact operators have been 
considered by Coburn [2] and were termed ‘extremely noncompact.” To study 
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this situation in more detail, we introduce two classes of operators in B(H): 


ZUC ={T € £(H)|0 is the unique compact operator that commutes with T} 


and 


ZUCA ={T € B(H)|0 is the unique operator in P(T) that commutes with T}. 


Clearly, ZUC N C(H)® ZUCA CcHy® and, as we shall see, these inclu- 
sions are proper. The following fact, whose proof is omitted, constitutes the 


only general necessary condition known to us for membership in the classes 
ZUC or ZUCA. 


Proposition 1. An operator in B(H) cannot belong to ZUC or ZUCA if 
it has a compact direct summand. 


In the first section of this paper we show that several classes of oper- 
ators are in ZUCA be virtue of being in ZUC N C(H)°. In the second sec- 
tion we provide criteria for a weighted shift to belong to the various opera- 
tor classes CH), ZUC, and ZUCA, In the final two sections we consider 
some counterexamples and open questions. Any terms not defined in this 
paper may be found in [5]. 

At this time we would like to thank Professor C. R. Putnam for his many 


helpful discussions. 


1, Operators in ZUC M C(H)°. What sort of operators are in ZUCA? 
Many operators are in ZUCA by virtue of being in ZUC M C(H)®. We begin 
the investigation of this latter subset by identifying a large class of oper- 
ators in C(H)?®. 

Let 7r,(T) be the essential spectral radius of T € B(H). Although there 
are several notions of essential spectrum, it was shown in [9] that the cor- 
responding essential spectral radii are all the same. Hence r,(T) is unam- 
biguously defined as, for example, max {|A| |A € Fh ees Spectrum (T + C)}. 

Definition. T € B(H) is essentially normaloid if r(T) = ||T|. 

In [7] it was observed that seminormal operators with empty point spec- 
trum are essentially normaloid, and the following proposition was proved: 


Proposition 2. Every essentially normaloid operator is anticompact. 


Our strategy for this section may now be described. We will use Propo- 
sition 1 to restrict our attention to certain essentially normaloid operators. 
Then, in view of Proposition 2, to prove that such an operator is in ZUCA 
it suffices to show that the operator belongs to ZUC. 
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Theorem 1. A normal operator is in ZUC M1 C(H)° if and only if its point 
Spectrum is empty. 


Proof. Since any eigenspace of a normal operator is a reducing subspace, 
a normal operator with an eigenvalue has a compact direct summand and by 
Proposition 1 is not in ZUCA. 

Conversely, let N be a normal operator with empty point spectrum. By 
the preceding discussion it is sufficient to show that N € ZUC. Suppose that 
C is a compact operator and C commutes with N (written C ++N). We 
show C=0. Now N#C implies N + c* (Fuglede’s theorem). Thus N 
«++C implies N C*C. Since C*C isa positive, compact operator, the 
Schmidt (polar) decomposition asserts that the spectrum of C*C consists of 
0 and a (possibly empty) decreasing sequence of positive eigenvalues, each 
of finite multiplicity. 

Suppose that E is an eigenspace of ie corresponding to a positive 
eigenvalue, It is easy to check that N «+ c*c implies E is an invariant 
subspace of N. Since E is finite dimensional, this means that N must have 
an eigenvalue, which contradicts our hypothesis. Thus the spectrum of C*C 
is {0}. Hence C*C = 0, which implies C = 0. Q.E.D. 


Theorem 2. An isometry is in ZUC MX C(H)® if and only if its point spec- 
trum is empty. 


Proof. Express the isometry in its Wold decomposition [5] as U ® W, 
where U is a pure isometry (i.e. a unilateral shift of some multiplicity) and 
W is a unitary operator. Any eigenspace of the isometry must be an eigen- 
space of the unitary part, and hence a reducing subspace of the isometry. 
Thus if an isometry has an eigenvalue, it has a compact direct summand, and 
by Proposition 1 it is not in ZUCA. 

Conversely, if the point spectrum of the isometry (a subnormal operator) 
is empty, Proposition 2 is applicable, and it is sufficient to show that the 
isometry is in ZUC. 

First, consider a pure isometry U. U is defined by 


where the x; are elements of a fixed Hilbert space K such that 2 lx, lI? < 
ce, Let x € K be a fixed unit vector, and define e, = (0,..., 0, x, 0,-++) 
where x is the nth component of e,. Then fe, }"°_, is an orthonormal se- 


quence in the domain of U. Suppose C is a compact operator and C + U. 
Then 
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UC(e,) = CUle,) = Cle, 
which implies 


= Cle, , = [1Cle,)]] = = |] Cle 


Because C is compact, lim C(e,) = 0, and hence ce.) = 0 for every n; that 
is, C= 0, 

Consider any compact operator with the isometry. 
Consnpending to the Wold decomposition 4 wl of the isometry we have C = 
og p> where A, B, C, and D are compact. From the commutativity of these 
operators it follows that A «+ U and D + W, so by the above paragraph and 
Theorem 1 we have A= 0 and D=0, Further, CU = WC, and if we consider 
e,, as above we have 


= CUle,) = Cle, ,,) 
and «++ = ||Cle, = As before, the compactness 


of C implies that C=0, Lastly, BW = UB, so that w*B* = B*U*, Again 
letting e, be as above, and recalling that U* is the backwards shift we have 


* *,,* 
U*(e 


)=B*(e) 


= = 1B *(e,)I] = = pil = 0 


so that B* = 0, whence B = 0. Q.E.D. 

Before proceeding to the last classes of operators in ZUCN C(H)°, we 
state and prove a proposition that will be used to show that the operators are 
in ZUC. The fact that ZUC and ZUCA are invariant under adjunction is 


easy to verify and is used in the proposition. 


Proposition 3. If an operator has empty point spectrum and its adjoint 
has so many simple eigenvalues that the corresponding eigenvectors are fun- 
damental in H, then the adjoint of the operator (hence the operator itself) is 
in ZUC. 


Proof. Suppose C ++ T and C is compact. By an argument similar to 
the one used in the proof of Theorem 1, it is clear that spectrum (C) = {0} = 
spectrum(C*)., We show that C* = 0 by showing C*(x) = 0 for any eigenvec- 
tor x associated with a simple eigenvalue A of T*. Since C ++ T, we have 
C* «+ T* so that T*C*(x) = C*T*(x) = AC*(x). Since A is a simple 


and 
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eigenvalue of T*, x must be an eigenvector of C*, Because spectrum (c*) 
= {0}, we have C*(x) = 0. Q.E.D. 


Theorem 3. Each of the following (classes of) operators is contained in 
ZUC m C(H)® C ZUCA: 

(a) the discrete Cesaro operator, 

(b) multiplication by a bounded schlicht function on some Bergman space, 

(c) Toeplitz operators whose corresponding multiplication function is 
schlicht. 


Proof. It is well known that these operators are subnormal and have emp- 
ty point spectrum; thus, in accord with the strategy of this section, it is suf- 
ficient to show that they belong to ZUC. This we will do by showing that in 
each of these cases the hypotheses of Proposition 3 are satisfied. 

Proof of (a). In [1] the following facts were proved: the point spectrum 
of the adjoint of the discrete Cesaro operator is {A||1— A] < 1}; each of these 
eigenvalues is simple; when I? is identified with the Hardy space H? in the 
natural manner, the function (1 - z)i/an1 is an eigenvector associated with 
A. It remains to show that these eigenvectors are fundamental. By consider- 
ing A= 1, 1/2, 1/3,+++ it is easy to see that the span of the eigenvectors 
includes 1, z, z*,+++. Thus the span of the eigenvectors of the adjoint of 
the discrete Cesaro operator is dense. Q.E.D. 

Proof of (b). Let 

D =a fixed region in the complex plane, 
¢ = a bounded schlicht function on D, 
T = multiplication by ¢ on A7(D), 

K, = reproducing element for ‘‘evaluation at A’’ functional 5). 

Since {K,},¢p is fundamental in A?(D), it is sufficient to show that f(A) 
is a simple eigenvalue of T* with corresponding eigenvector K,, for each 
A €D. To do this recall that 


ker (T* = ran(T - 


Thus, using the definition of K), it is easy to check that K, is an eigenvec- 
tor associated with (A). To see that (A) is simple we verify that 
ran(T — A(A)I) is the kernel of a linear functional, viz., 


ran(T f(A)I) = fg € A(D)|g(A) = 0} = ker {5,}. 


Now we clearly have 
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ran(T = igle(z) = (plz) A(A))/(z) for some f € A*(D)} 


Cig A>(D)|g(d) = 0}. 


For any g € A*(D) such that g(A)= 0 we may define f(z) = g(z)/(d(z) - d(d)), 
and the problem reduces to showing f{ € A?(D), { is defined at z =A since 


(z) 
g 
dz)- Gd 


and #'(A) 40 because ¢ is schlicht [11, p. 198]. It is similarly easy to 
check that f is differentiable at z = A, To see that f € L?(D), note that / 
is continuous on a disc D) centered at A and contained in D. Thus f is cer- 
tainly in L*(D,). It suffices to show that |f(z)— A(A)| is bounded away from 
0 on D\D,. If this were not true, there would exist zn 1, 2,cce, in 
D\D, such that f(z) — f(A) as n — o. Since ¢7! is also analytic on D 
[11, p. 199], z,— Aas n-+, This is a contradiction. Q.E.D. 

Proof of (c). Using the representation of the Hardy space as H*(D) where 
D is the open unit disc, the proof is essentially the same as in part (b). The 
only difference is that for g € H?(D) such that g(A) = 0, it must be observed 
that f27 |fre®)|? a0 is uniformly bounded for r sufficiently close to but less 
than 1, where f(z) = g(z)/(f(z) — d(A)). The proof of this observation is also 
analogous to the corresponding one in part (b). Q.E.D. 

Remark 1. The above classes of operators in ZUC (ZUCA) are all hypo- 


normal (even subnormal) and have empty point spectrum. From Proposition 1 
and the fact that eigenspaces reduce hyponormal operators it follows that the 
empty point spectrum assumption was necessary for such operators to be in 
ZUC (ZUCA). However, this necessary condition breaks down for seminormal 
operators. For example, the adjoint of the unilateral shift is in ZUC (and 
ZUCA) by Proposition 2; yet its point spectrum is the open unit disc. 

Remark 2. Although the result of Shields and Wallen [10, Theorem 2] im- 
plies that their multiplication operators M, belong to ZUC, Proposition 3 is 
applicable to a more general situation where their condition (c) is significantly 
weakened and condition (d) is eliminated. We also mention that Theorem 3(c) 


has recently beeri proved independently by Deddens and Wong [3]. 


2. Weighted shifts. In this section we consider the following question: 
Which weighted shifts belong to the classes C(H)°, ZUC, and ZUCA? We 


will use the following notation for a weighted shift throughout this section: 


T=Liae 


n ntl 


n=1 
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T(x) = (x, ee 


n=1 


n+1 


where a Sa is an orthonormal basis of H, chosen in such a way that the 
weights @, are nonnegative. If T had a zero weight it would have a finite 
rank direct summand, and by Proposition 1 it would not be in ZUC or ZUCA. 
Hence, we will require that all the weights be positive. 

We begin by characterizing the weighted shifts in ZUC. For T € B(H) a 
necessary condition for T to be in ZUC is that T” be noncompact for every 
positive integer n. It is interesting to note that for weighted shifts this con- 
dition is also sufficient. 


Theorem 4. A weighted shift T with positive weights a, belongs to 


ZUC if and only if there does not exist a k, >1 so that lim, (2, 
= 0. 


Proof. If there exists k, > that lim nat 1) = 0, then 
by the Schmidt isetiossiion rr?” ww compact and T is not in ZUC. 
Conversely, suppose C ¢+ T. This is equivalent to 


TCle,) = CTle,) =a, Cle, ,,) for all n. 
T* 


n 1 


Cle 


enti 


If T is not in ZUC, then we may assume that the above C is compact and 
nonzero. Thus C(e,)# 0 and we may write C(e,) = 2* j=ko Be; with B,, # 


0. Because ||T"(C(e,))|| > |B, C is we have 


= lim Ile, = tim 


2 lim| lima, 
Br, a, eee a, n nt+ko-1 


Hence from the term immediately after the inequality we see that k, > 1, and 
it follows that lim, ,)= 0 Q.E.D. 

The following remarks will be useful later, and refer to a weighted shift 
T with positive weights. 
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Remark 3. If T ¢ C(H) and T ¢ ZUC, then the k, in this theorem sat- 
isfies > 3. 

Remark 4. If 04 C € C(H) and C + T, then C(e,)= ako Be; with 
#0 and ky > 1. Thus for n> 1, 


T” 1 


Cle 4) a 
n n 1 


so that C(e, ,,) is orthogonal to ¢,,..., 

Remark 5. If C € C(H) and C ++ T, then C =0 if and only if C(e,)= 
0, for some integer n. 

In [7] a characterization of the weighted shifts with nonnegative weights 
in CH) was given, namely: 


Proposition 4. A weighted shift with nonnegative weights a, belongs 


to C(H)° if and only if sup, a, = lim sup, 


Thus combining Propositions 3 and 4, we obtain a characterization of 
all weighted shifts in ZUC M C(H)° in terms of the weights. From this char- 
acterization it thay be easily verified that 


Corollary. A hyponormal weighted shift is in ZUC MN C(H)° if and only 
if its point spectrum is empty. 


We do not know a necessary and sufficient condition for a weighted shift 
to be in ZUCA, We do know, however, that the weighted shifts in ZUCN 
C(H)° do not exhaust the weighted shifts in ZUCA. The next proposition 
will enable us to exhibit such an example. 


Proposition 5. Let T € C(H)° be a weighted shift (with positive weights) 
which attains its norm. Then T € ZUCA. 


Proof. Let m be an integer such that a, = ||T||. Suppose that 04 C € 
F(T) and C ++ T. Then 


By Remark 3, k, > 3, so, by Remark 4, € +1 iS orthogonal to C(e,). So 
\|T\|? > a2 + \Cle,)I|?, whence C(e)= 0, Thus, by Remark 5, C = 0. This 
proves that T € ZUCA. 

Remark 6. We now use this proposition to prove that the inclusion ZUC 
A C(H)® C ZUCA is proper. Consider the operator 


1 


n 
nodd n even 
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From Proposition 4 and Theorem 4 it follows that T € C(H)® and T ¢ ZUC. 
However, Proposition 5 is satisfied so T € ZUC. 

The condition, in Proposition 5, that T attain its norm may be relaxed 
to the condition that a subsequence of the weights approaches the norm rel- 
atively quickly. To be more precise, suppose for T ¢ ZUC we let ky be 
the smallest integer so that k, > 1 and the condition of Theorem 4 is satis- 
fied. Then we have 


Proposition 6. If T is a weighted shift with positive weights, T € CcH)?°, 
T ¢ ZUC, and for every B>0O and k>k, there exists an m depending upon 
B and k so that 


WTI? - 02 ,,<(Ba, a2,,_ +++ a,), 


then T € ZUCA. 


The proof is omitted since its essence is contained in the proof of Prop- 


osition 5. This result enlarges the class of weighted shifts known to be in 
ZUCA. 


3. A counterexample. It has been established that all normal operators 
with empty point spectrum and several other classes of hyponormal operators 
with empty point spectrum are in ZUCN C(H)® C ZUCA. One might suspect 
that all hyponormal operators with empty point spectrum are in ZUCA. This 
is decidedly not the case as is demonstrated by the following proposition 
and its corollary. 


Proposition 7. There exists a quasinormal operator with empty point 


spectrum having a nonzero commuting compact operator. 


Proof. Let H = /?, le , the standard orthonormal basis in l?, and 
define Po(x)= 2", a,x,e, where x= 2", and a, >a, 0 for 
all n. P) is a positive operator on l?, Let T = UP be the dilated shift oper- 
ator defined by Po, i i.e., dom(T) = Hy H, =H, P= P P, = and 
U = unilateral shift on Or H. Now the paiet spectrum of T is cna since 
P, is injective, and UP = PU, so T is quasinormal. 

We recall the Rellich criterion for compact operators: an operator C is 
compact if and only if for any «> 0 there exists a finite codimensional sub- 
space V, such that ||C|V,|| <« Let Ci C(H). The Rellich criterion implies 
that C = ‘O= C, defined on OF H, is compact if and only if ||C;|| + 0 as 
jae. It is iia easy to verify pt C + T if and only if 


forall j. 
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So it suffices to make a choice of C; satisfying these equations and such 
that ||C;|| > 0. 

_ Define C; = > where as n and = 
Let us now require that sup, (a 4,/a,)=A<1 (eng. 
= 27(*))), Then < < * gt and since Ic, = sup, 
we have ICI — 0 as n-+~«, In addition, each C; is compact since po”? 
— 0 as n+ &, Finally, condition (*) is satisfied so that C + T. 


Corollary. There exists a quasinormal operator with empty point spec- 
trum having a nonzero commuting compact best approximant. 


Proof. Let T and C be as in the previous example, let N be a normal 
operator with empty point spectrum on some Hilbert space, and consider the 
operator N ®T, on the appropriate Hilbert space KH. N @ T is a quasinormal 
operator, and its point spectrum is empty. Suppose that ||N|| > ||T — Cl] and 
N|| > Tl]. In [7] it was proved that if C, is a best compact approximant to 
N and C, is a best compact approximant to T, then 


dist(N ® T, = ||IN@T-C, @ 


Because 0 is a best compact approximant to N (by Proposition 2) and 
\|T C,|| < < it follows that 


dist(N T, C(})) = max |T = 
Thus if we ler K= 0 ®C £40, we see that K#*N @®T and 


® T Kl = ||N|| =dist(N @ T, CH). Q.ELD. 


4, The discontinuous nature of ZUC (ZUCA). The relationship between 
the metric complement C(H)° and its subsets ZUCA is interesting. For ex- 
ample, the possibility that ZUCA is dense in C(H)°® is an intriguing but 


open question. However, neither ZUCA nor ZUC is closed. 


Proposition 8. There is a sequence of selfadjoint operators with empty 
point spectrum that converges to the identity operator. 


Proof. Let S$ be any selfadjoint operator with empty point spectrum. 
Evidently T, =1+€)S, € —+ 0, is a sequence of selfadjoint operators with 
empty point spectrum converging uniformly to |. Q.E.D. 

By Theorem 1, the T, $ are in ZUC and ZUCA; however, ! is in neither. 
Such a phenomenon illustrates the delicate and discontinuous nature of the 
ZUCA property since we have just exhibited a sequence of operators each 


of whose set of commuting best compact approximations is zero dimensional, 
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but whose (norm) limit has an infinite dimensional set of commuting best com- 
pact approximations. 
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ABSTRACT. This paper presents an application of radical theory to 
the structure of commutative semigroups via their semilattice decomposi- 
tion. Maximal group congruences and semisimplicity are characterized 
for certain classes of commutative semigroups and Nesemigroups. 


The concepts of a radical theory and semisimplicity in semigroups ana- 
logous to that of ring theory have been studied by a number of authors, both 
as a general theory, and applied to specific classes of semigroups. (See 
e.g. {1], [3], [s]-[9].) In this paper we apply these techniques to a study of 
the structure of commutative semigroups. 

Every semigroup S has a least congruence 1 such that S/u is a semi- 
lattice Y. Each congruence class of p is a subsemigroup of 5, and the 
collection iS Js a € Y, of congruence classes is called the greatest semi- 
lattice decomposition of S. Conversely, if Y is a semilattice and iS 3, 
a€ Y, is acollection of pairwise disjoint semigroups, then any semigroup 
S= Uis.: a € Y} with the property that for a, B € Y is a semi- 
lattice composition of the S. Thus a natural approach to the structure of a 
given type of semigroup is through a characterization of the semilattice 
decompositions, the structure of the S,, and the semilattice compositions. 


The semilattice decomposition of commutative semigroups was described by 


Tamura and Kimura [12]. In this case the semigroups S$, are the maximal 


archimedean subsemigroups, where S, archimedean means given any two 
elements of Ss. each divides some power of the other. Conversely, the 
general solution of the semilattice composition problem is known (see [10, 
Theorem III.7.2]). 

If r is a congruence on a semigroup S, we say 7 is modular if there 


exists an element e in S such that (ex)7(xe)rx for all x in S, The radical 
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congruence p is defined to be the intersection of all the maximal, modular 
congruences on S, and S is said to be semisimple if p = t, the identity rela- 
tion. We begin here a study of semisimple commutative semigroups. The 
semilattice decomposition of such semigroups is described, and we obtain 
partial results on the nature of the S, and semilattice compositions. As a 
related problem, we also obtain conditions for the existence of maximal 
group congruences on certain classes of N-semigroups. My thanks to the 
referee for the suggestion of Theorem 3. 

If S is a commutative semigroup, a mapping ¢ from S into S is a trans- 
lation if (xy) = x(y¢) for all x, y in S. We denote by T(S) the set of all 
translations of S. If the commutative semigroup S is a semilattice of sub- 
semigroups S, and a > B, then S, U S, is evidently an ideal extension of 
Sg by S,U tO}. For each a €S,, let the mapping ¢, be defined on Sg by 
xb, = for all x € Spe Then € T(S,) and $,2:4-—+ ¢, is a homomor- 
phism from S, into T(S,). Further, every such homomorphism determines an 
extension 5, US 3 with multiplication defined in the obvious way [13]. 


Oehmke [9] has characterized maximal modular congruences on a com- 
mutative semigroup, and we state his result as a lemma. 


Lemma 1. Let S be a commutative semigroup and rt a maximal modular 
congruence on S, Then either 

(i) S/r is a cyclic group of prime order, or 

(ii) S/ is the semilattice {0, 1}. 


Theorem 2. Let S be a commutative semisimple semigroup and let S = 
Us, a € Y, be the greatest semilattice decomposition of S, Then each S, 
is semisimple and cancellative, and a > B implies S, is isomorphically 


embedded in T(S 


Proof. Let x, y € S_, then S semisimple implies there exists a maximal, 


modular congruence 7 on S such that * #y(modr). The restriction - of r 
to S, is clearly a congruence on S Further, if 7 is of type (ii) (Lemma 1) 
then 7, cannot separate elements of Ss. since Ss. is archimedean and has no 
proper prime ideals. Thus 7 and hence 7, must be of type (i). It follows 
that 7, is a maximal modular congruence on S., so S, is semisimple. The 


fact that all the maximal, modular congruences on S, are cancellative and 
their intersection is the identity congruence says S, must be cancellative. 
Suppose a > B and a, b € S, with ap that is, ca = cb for c € Spe 


If 7 is any maximal, modular congruence on S of type (i) then obviously 
(ca)r (cb) and thus @7b since 7 is cancellative. If 7 is a type (ii) congruence 
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then again a7b holds since @ and 6 are in the same archimedean component. 
It follows that a7 b for all maximal, modular congruences 7 on S, and by 
semisimplicity,@= 6. Thus ¢, B is one-to-one, proving the theorem. 

Each S. of the theorem is thus a commutative, cancellative, archime- 
dean semigroup. If 5, contains an idempotent then it is an abelian group. 
If such a semigroup does not contain an idempotent it is called an N-semi- 
group. To complete a characterization of commutative semisimple semi- 
groups it is now necessary to describe the semisimple archimedean com- 
ponents S,, and then determine those semilattice compositions of the 5S. 
which are semisimple. It is evident that an abelian group G is semisimple 
if and only if the Frattini subgroup of G is trivial, that is, M{G?: p is a 
prime} = {fe}. If, in addition, G is periodic (torsion), then G is semisimple 
if and only if each of its p-primary components is elementary abelian. If G 
is finitely generated, it is semisimple if and only if its torsion subgroup is 
semisimple. 


Theorem 3. Let S be a semilattice of abelian groups {G_: a € Y}, with 
linking homomorphisms $ , B Then the following are equivalent. 


(i) S is semisimple, 


(ii) Each $a, 2? a > B; is one-to-one and the direct limit lim G. is 


semisimple, 


(iii) S is the subdirect product of a semilattice and a semisimple group. 


Proof. We show (i) = (iii) — (ii). (i) = (iii) is obvious. 

Suppose (iii). Then, by Theorem 2, each ?a,B is 1-1. Further the 
maximum group homomorphic image S/o is isomorphic to lim G,; here 9 = 
{(a, b) € S x S: ea = eb for some e* =e € Sh. 

Suppose S C E x G where G is semisimple. Then the projection 7 of 5 
onto G is a group homomorphism so that 9C 7° 71, On the other hand, 
let = (a,,4,), b= (b,, 6,) be in S and suppose a7 = bz. Then a, 
and so aa~'bb~1a = aa~'bb~'b; that is Co. Hence 
and G = S/o= lim G,. Thus (ii) holds. 

Assume (ii). Since each G 5 is a group, TG) is isomorphic to Gs so 
for a > B we have G, is embedded in Ga Let @ and 6 be distinct elements 
of S. If a and b are in different G_ then it is clear that there is a maximal modular 
congruence of type (ii) (Lemma 1) which separates @ and b, so assume 4, 
beG. If eg is the identity of Gps then ae, = ag , ap? and since the linking 
homomorphisms are one-to-one, (4, b) ¢ 9, so that (iii) holds. S is in fact 
the subdirect product of Y and lim G,. 
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Similarly, one can obtain a global characterization of commutative 
semisimple semigroups as follows. A commutative semigroup S is semi- 
simple if and only if it can be embedded in the direct product of a semi- 
lattice and a semisimple group. 

In general the converse of Theorem 2 does not hold without additional 
assumptions, even in the case where each S, is a group. Jordan has given 
a converse of Theorem 2 for H-semigroups that are inverse semigroups or 
periodic in [6, Theorem 3] and [7, Theorem 5], respectively, by assuming 
the existence of a collection of subsemigroups with certain properties. In 
each case the semisimple semigroups are necessarily semilattices of 
abelian groups, hence a special case of Theorem 2. For the periodic case 
the following corollary sharpens Theorem 5 of [7] by eliminating the extra 
condition to give a converse of Theorem 2. 


Corollary 4, Let S be a periodic semigroup which is a semilattice of 
semisimple abelian groups G,, a € Y, such that the multiplication homomor- 


phisms are one-to-one, then S is semisimple, 


Proof. Each G, is periodic abelian and semisimple so its p-primary 
components are elementary abelian for each prime p. It follows that the p- 
primary components of lim G, are elementary, so lim G, is semisimple and 
hence so is S, 

Another finiteness condition that yields a converse for a semilattice of 
groups is that the semilattice Y has a zero. (See [7, Corollary 5.5].) 


Corollary 5, Let the semigroup S be a semilattice of semisimple abelian 
groups G., a € Y, where Y has a zero, and such that the multiplication 
homomorphisms are one-to-one, then S is semisimple, 


Proof. In this case lim G_ is isomorphic to G, which is semisimple, 
a 


and the semisimplicity of 5 follows. 

We now turn our attention to the other possibility for the subsemigroups 
S$.» 4 commutative, cancellative, archimedean semigroup without idempotent, 
or N-semigroup. Examples of such semigroups are the positive integers, 
positive rationals and positive reals under addition. Tamura [11] has given 
the following characterization of N-semigroups. Let N denote the set of 
nonnegative integers and let G be any abelian group. Let | be a mapping 
from G x G to N satisfying: 

(i) (a, b) = 1(b, a), a, b EG, 
(ii) (a, b) + Kab, c) = bc) + (b, c), a, b, EG, 


| 
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(iii) for a € G, Ia”, a) > 0 for some m > 0, 

(iv) Ke, e)= 1 where e is the identity of G. 

Denote by (G, !) the set N x G with the binary operation (m, a)(n, b)= 
(m+n+ l(a, b), ab). Then (G, I) is an N-semigroup, and every N-semigroup 
is obtained in this manner. We note that neither G nor ! is uniquely deter- 
mined by S. 

I¢ S = (G, 1) is an Nesemigroup then its maximal modular congruences 
must all be of type (i) since it is archimedean. Hall [4] has characterized 
homomorphisms of an N-semigroup into an abelian group G’ as follows. Let 
¢ be any mapping from G into G’ satisfying 


(1) (add) = (ed)! Xat)d, a bEG. 
Define O, from S into G’ by 


(2) (m, a), = (ep)(a¢). 


Then 04 is a homomorphism of S into G’, and every homomorphism is of 
this type. Thus, to characterize maximal congruences on N-semigroups, and 
thereby the semisimple N-semigroups, we need to determine the existence of 
mappings satisfying (1) onto a cyclic group of prime order. In general this 

is difficult without additional assumptions on either G or I. Note that a map- 
ping ¢ satisfying (1) will be a group homomorphism if and only if ed = e’, 
the identity of G’. Otherwise, ed will be a generator of G’ since it is of 
prime order. It is the latter case that is our primary interest since the homo- 
morphism theory is well known. For S = (G, 1) and a € G with |a| = m, the 
order of 2, we denote I(a) = > ACE a*), 


Theorem 6. Let S = (G, I) with G generated by a and let G' be a group 
of order p, a prime, There exists a mapping ¢ {rom G onto G' satisfying (1) 
which is not a homomorphism except for the case where G is finite, p 
divides |\G|, and p does not divide l(a), The value of ed in G' is arbitrary 
e'). If G is finite and p does not divide |G| then ad is uniquely deter- 
mined by ed, otherwise it may also be chosen arbitrarily. 


Proof. If G is infinite cyclic, then let ed = g #4 e’ in G' and let ad = gi 
for some 1< i< p. Inductively we define for > 1, 


n—-1 
(3) = g*™), where k(n) =ni- Ka, a’), 
j=1 


and a~'¢ = g*, where k = (a, a~!)— i+ 1 (mod p) and hence is uniquely 
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determined modulo p given i. If G has order 7, then using (3) we see that 
a" = ed if and only if 


(4) ni= (a) (mod 


Obviously (n, p)= 1 implies a unique solution 7, while (”, p)= p = (I(a), p) 
implies i may be chosen arbitrarily. No solution exists in the single case 
of the hypotheses. To check (1) for any two elements a*, a’ in G, the con- 
ditions on the exponents of g give equality if and only if 

k+j-1 k-1 j-1 


Ka*, a’) = Ka a)- a’) - Ka, a’) (mod p). 


r=1 r=1 r=l1 


From Lemma 2 of [2], 


k-2 k-2 
Kak, a’) = Ka, Ka, a*)- Ka, 1-7), 

r=0 r=0 
which is easily seen to be equal to the right side of the congruence, so this 
congruence holds for all p, and (1) is satisfied if G is infinite or 7+ k< 7. 
If j+k>nthenj+k-—n=t<nwhenG is finite of order , and qith 
a‘, Then (4) gives 

j+k-t-1 


aa’), 


r=1 r=t 


so that qitke = a‘'d and (1) holds in this case as well. 
The next result allows us to extend our definition of ¢ to a large class 
of groups. 


Theorem 7. Let S = (G,1) where G is the direct product H x K, 
Assume gd, and $, are defined on H and K respectively to satisfy 
(1) such that ef, = ep,. Set ed = ed, and for hk €G define 


= "hd, )(k,), then satisfies (1) on G. 


Proof. Let x = ab and y = cd be elements of G, where a, c € H and 
b,deéK, Then 


= (eg) ag Mod Ned 
(xy)p = (achd)h = (odd, 


(eg) ag, ed Medd > 
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Multiplying (xy)¢ by (e)'“” makes the exponent of ed equal to I(ab, cd) - 
I(ac, bd) — Ka, c)— K(b, d). By Lemma 6 of [2], this is equal to — Ka, b)- 
I(c, d), so (1) is satisfied. 

If G is semisimple then there are lots of maximal congruences on G and 
it is natural to expect a relationship to the semisimplicity of 5 = (G, I). The 
next result shows that this is the case at least when G is finitely generated. 


Theorem 8. Let S = (G, I) where G is a finitely generated semisimple 
abelian group, then S is semisimple. 


Proof. If (m, a) and (n, b) are two elements of Swith a # b then any 
homomorphism ¢ separating @ and 6 will give a homomorphism 94 separating 
(m, a) and (nm, b). Thus consider (m, a) # (n, a) in S and write G = 1% 
where G, = (,). Let p be a prime such that (p, m— n) = (p, Ie,|)= (0, Ka,))= 1 for 
k=1,...,¢. By Theorems 6 and 7 we can define a mapping ¢ which is not 
a homomorphism from G onto a cyclic group G’ of order p. Further, (m, a), # 
(n, a)04 since (p, m-n)=1, so S is semisimple. 

If G is any abelian group and we define l(a, b)= 1 forall a, b in G, then 
S = (G, I) is an Nesemigroup. These N-semigroups are of interest since they 
give lots of examples, are relatively easy to study, and they turn out to be 
fundamental in a sense to the general theory. For this class we are able to 


obtain a converse to Theorem 8, though it is not true in general. 


Theorem 9. Let S = (G, I) be an N-semigroup with G finitely generated 
or periodic and I(a, b)= 1 for alla, b in G, If S is semisimple, then G is 
semisimple, 


Proof. The torsion subgroup of G is the direct product of p-primary sub- 
groups Let a € G, with |a| = p",n>1. If n>1thena# so there 
is a homomorphism 94 onto a group G’ of prime order 9 separating (0, a) and 
(0, a?*1), Thus ad = (0, a6, # (0, a’*1)6, = athe so that ¢ is not a homomor- 
phism. Since (1) holds, ef = g is not the identity of G’ and must therefore 
generate G’. Letting ad = 1< i<q, we have ah = foe all 
k €N by induction. If g 4 p theng = ed = = implies p”i 
p” +1=1 (mod q) soi=1 (mod q). But then i= 1s0a¢= a con- 
tradiction. On the other hand, if 7 = p, then i = (p + li- (p + 1) +1 (mod p) 


gives af = again. We conclude that n= 1, so G, is elementary 


abelian and G is semisimple. 


A general characterization of semisimple N-semigroups appears to be 
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quite complicated due to two factors. First is the complicated structure of 
G itself when it is not torsion or finitely generated. Secondly, the condi- 
tions on the function ! are quite general so that large numbers of them exist 
and not much can be said about them [2]. For this reason, the conditions 
for semisimplicity turn out to be number theoretical restrictions on /. We 
conclude with a characterization for the two cases where G is finitely gener- 
ated or O(p~) for some prime p. 


Theorem 10, Let S = (G, I) where G is finitely generated abelian with 


s 


s 
torsion subgroup IT, = (a,) of order r, = and TI, 17, = M. For 
each k, let M, = M/r, and I, = I(a,). Then S is semisimple if and only if 
given any collection of integers 1,, k= 1,..., S, satisfying < s, and 
1, = 9 (mod p,), if > a ALA = Mz for some z € N, then there exist a 
prime p and some collection i, satisfying r,i, =1, (mod p), k=1,...,5, 


s 


such that z# LALA (mod p). 


Proof. Let (m, x) and (n, y) be distinct elements of S. A homomorphism 
0 ¢ of S onto a cyclic group of prime order where ¢ is also a homomorphism 
will separate (m, x) and (n, y) if and only if ¢ separates x and y. Thus if 
m n 
x=IIa, ky and y =Ila,*v, where u, v are from the torsion free part of G, are 
not separated by a maximal group homomorphism, then we may assume u = 
v and p,\(m, - n,)s k=1,..., 5. If ¢ satisfies (1) and is not a homomor- 
i 
phism then ed = g # e’ and a,P=e8 where i, satisfies r,i, = 1, (mod p) 
by (4). From (2) and (3) we get (m, x) 4 is the element g raised to the 
power m+ zen + F, where Fl is an integer depending only on x. 


Thus (m, x), = (n, y)9, if and only if 


s 
(5) m-n= DX (n, - m,)i, + F, - F, (mod p). 
k=1 


Set 1, = m, and assume MY The terms of the summation 


depend only on x and y, so for any m, n we must have M(m - n) # =1,M,1, + 
M(F,, - F ). Thus we can choose a prime p/ M so that the conditions of 


Theorem 6 hold for each Gy» there are unique solutions i, tor,i, = I, 


(mod p), and M(m—n)# =1,M,!, M(F F,) (mod p). M=r,M, and I, = 
r,i, (mod p) imply M(m — n) Fa =M1,i, + M(F - F,.) (mod p), and since 
(M, p) = 1, (5) cannot hold. If on the other hand, =1,M,1, = Mz for some 
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integer z then M divides =1,M pip + M(F - F,). The above argument will 


work to give separation of (m, x) and (n, y) except when m and n satisfy 
m-n=Zz+ ry - F Now (5) fails for such a pair m, n if and only if z# 


= l,i, (mod p) which is the condition of the theorem. 


Theorem 11. Let G = o(p™) for some prime p and S = (G, 1) for some 
index function 1, G = (a,, 45, where at =e and a? =4,_, for 
n>1. Let I, =I(a_). Then S maps homomorphically onto a group of order 
q for every prime q# p. Further, S maps onto a group of order p if and only 
if p divides I,. 

Proof. If g # p and G= (a,) then Theorem 6 gives a unique i, Satis- 
fying (4) and we define a, d= g” where (g) = G’ of order g. This is well 
defined on G if and only if a ¢ = (a? .). Using (3) and letting K,= 

1)» We get equality if and only if i, = pi K,, (mod q) 
for all n. Since p # 4, this holds if and only if 


p”i = = p” p"K (mod q) b”K,, (mod 


n+1 


Substituting = +1 in the last congruence is 


p” 
a’ net) =I (mod 9). 


We now claim that we actually have equality in this last expression, that 
is, simplifying the notation a little, if @ € G has order p”*", then 
> Ka, a’)-p” Ka, a’). 
j=l j=1 


From Lemma 2 of [2] we have 


p-2 p-2 
Ka, = Na, a? 4 > Ka, > Ka, 1-ky, 
k=0 k=-0 
Simplifying gives 


p-1 
Ka?, a??) = a, abi*k)_ 5” Ka, a*) 


j=1 k=0 


pr+l 


Using the fact that @ = e, the first expression on the right becomes 


j=l 
k 
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4 Ka, a ) and our claim is proved. This implies ¢ is well defined and 
so a homomorphism onto G’ exists. In particular we note that the above 


equality implies 


(6) I_ = - for all n. 


If g = p then Theorem 6 requires I, = 0 (mod p) for all n andi, is 
arbitrary. However ¢ is well defined if and only if i, =— K, (mod p) which 
has a unique solution for each n, giving the mapping 0 $ and conversely. 
Finally, (6) says |, = 0 (mod p) for all n if and only if p divides Is 


Corollary 12. p” divides |, if and only if p” divides 1,41 for all posi- 


tive integers n. 


Theorem 13. Let G = 0(p™) for some prime p and S =(G, I) for some index 
function where at =e and a? =a,_,forn>1. Let I, = 
K(a,). Then S is semisimple if and only if for each positive integer n, given 


u such that 1<u< p”, if p” divides ul,» then p”*! does not divide ul, 


Proof. Let (t, x), (s, y) be distinct elements of S, then for some mini- 
mal n we have x = a’, y= at, where (say) j >. If j=kthent#s and to 
separate these two elements by (3) we need only satisfy t - s 4 0 (mod q) 
which is possible by Theorem 11. Thus assume j 4k. Again using (3), we 
are able to separate (t, x) and (s, y) if and only if there exists a prime 7 
such that 

j-1 
(7) (j-k)i,#t-s+ Ka, a’) (mod 4). 
r= 


If does not divide (j then (Gj-)I, p"(t- s)+ a’) 


La 


for any ¢ and s, so there exists a prime 7 #4 p such that 


j-l 
(j- - s) +p” Ka, (mod q). 
r=k 


Choosing i, to satisfy (4) gives 
j-1 
(j - )p"i, # p(t -s) +p” > a’) (mod q)s 
r=k 
and since q # p; (7) holds. If, on the other hand, (j-k) ‘= p"z for some 
integer z, then we obtain separation as above except for those integers t, s 
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such that (j - s)+ p” Ka, a’), that is,z=t-s+ 


(a5 a’). It follows that we can separate (t, x) and (s, y) for such t, s 
if and only if there exist a prime 7 and i, satisfying (4) such that (j - k)i # 
z (mod q). We show that 7 must equal p. Obviously (j- k)I, = p”z (mod q) 
for every prime 4, and if q 4 p, then z = (p")~'(j- k)I, (mod q). If i, 
satisfies (4), that is =I, (mod 9), then (j - k)i, = (j- z 
(mod 7), so we must choose q = p. Since j—k< p” and (j - k) I= p”z we 
must have Pll, so S maps homomorphically outo a group of order p by Theo- 
rem 11. From the proof of Theorem 11 we observe _== K, (mod p), so we 
get separation if and only if — (j — k) K,, # z (mod p) or z + (j- k) K. #0 
(mod p). Now p"z = (j- = by (6) so 
(j k) = p"(z + (j -k) K,). From this equation, z + (j — k) 0 
(mod p) if and only if p"*’ divides (j- k)I,, , » proving the theorem. 
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ABSTRACT. This paper considers the question: Given anisotropic 
quadratic forms Q and Q' over a field K (char K # 2), if their function fields 
are isomorphic must Q and Q’ be similar? It is proved that the answer is yes 
if Q is a Pfister form or the pure part of a Pfister form, or a 4-dimensional 
form. The argument for Pfister forms and their pure parts does not generalize 
because these are the only anisotropic forms which attain maximal Witt index 
over their function fields. To handle the 4-dimensional case the following 
theorem is proved: If Q and Q’ are two 4-dimensional forms over K with the 
same determinant d, then Q and Q’ are similar over K iff they are similar 
over K{yal. The example of Pfister neighbors suggests that quadratic forms 
arguments are unlikely to settle the original question for other kinds of forms. 


Let Q be a nonsingular quadratic form defined on an n-dimensional vec- 
tor space V (n > 3) over a field K (char K # 2), with diagonal representation 


(a); Ai The function field of Q, Ko, is the quotient field of 


n 
2 2 e 
where a =a! (a, + a,x? 
n-1°°0 | 


The field Ko is uniquely de- 


termined (up to K-isomorphism) by Q, independent of the choice of diagonal 
representation. Further, if Q’ is another quadratic form which is isometric 
to Q, or even similar to Q (i.e., with a diagonal representation (aap, aa,, 
+++, @@,_,) for some K*), then 

We consider here the converse of the last sentence: 

(t) If Q and Q’ are two anisotropic forms over K, such that Ko. =Ko, 
must Q and 0’ be similar? 

We must confine attention exclusively to anisotropic forms when 


dim Q > 4, since Ko is purely transcendental over K iff Q is isotropic. 
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It was proved long ago by Witt [7], using the theory of algebraic function 
fields in one variable, that the answer to (fT) is yes if the forms are three- 
dimensional. In $1 we will give an affirmative answer if Q is a Pfister form 
or the pure part of a Pfister form (in particular, reproving Witt’s result). In 
$2 we will show that the answer is again yes if dim Q =4. We will indicate 
why the arguments used here do not generalize to othercases. Indeed, the 
example of Pfister neighbors suggests tha quadratic-form-theoretic arguments 
will not settle (t) except in the cases analyzed here.(?) 

We begin with a few remarks on notation and terminology, and a stan- 
dard lemma. Throughout the discussion the field K will be fixed, with 
char K # 2. Field isomorphisms will be K-isomorphisms. Each quadratic 
form Q will be nonsingular and (unless indicated otherwise) will be a K- 
form, i.e., a quadratic form defined on some finite-dimensional K-vector 
space V. As usual, dim Q is taken to be the dimension of V. The discrim- 
inant of Q, disc Q = d, is the image in K*/(K*)* of the determinant d of 
some matrix representing Q. (No sign is attached.) For Q’ another K-form, 
Q'=Q means OQ and Q’ are isometric. Q' is a subform of Q if there is 
another K-form Q” such that O20'1 0". O~a means Q represents a. 
For (a,, a) is an n-dimensional K-form which is 
represented by a diagonal matrix with entries @,,...,@,. If QO= 
(a,, then aQ= (aa,, Coe, Q is nearly hyperbolic if it is the 
orthogonal sum of a hyperbolic form and a l-dimensional form. If L isa 
field containing K, 9, denotes the L-form defined on V @, L induced by 
Q on V. For standard quadratic form results quoted without reference, the 
reader is referred to [4] or [2]. 

A Pfister form P is a K-form representable as a product P= Or (1, bs 


for some b,,..., be K*, Recall that for any aé k*, if P~a, then 
=aP and if P is isotropic, then P is hyperbolic. Of course, 


P, is again a Pfister form for any field L>K. Since P~1 we have 
the decomposition P =(1) 190. Q is called the pure part of the Pfister 
form P. Observe that Q, is the pure part of P,, and if Q, is isotropic, 
then it is nearly hyperbolic. A Pfister neighbor (following Knebusch’s 
definition) is a quadratic form R which is similar to a subform of a Pfister 
form P, with dim R>'%dim P. For details on Pfister forms, see Pfister’s 
original paper [6], or the excellent accounts in [2] and LB}. 


We state for the reader’s convenience a well-known lemma which pro- 


(2) All of the results given here for the function field of a form apply equally 
well to its homogeneous function field, which is a simple purely transcendental 
extension of the function field. 
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vides the opening wedge for our consideration of function fields. See, for 
example, [2, p. 200] for a proof. 


Lemaa 1. Take dé K* and let L= er Any anisotropic K-form Q 
can be decomposed Q& (1, -d)®Q,10,, where 9,, is anisotropic. (In 
particular, if. Q, is hyperbolic, the Q, term disappears.) 


1, Function fields of Pfister forms. The following notation will be used 
throughout this section. Q will be a K-form of dimension n > 3, m=n-—-2. 
F = K(x,, wee, ¥_) and M= F(x )s where the x.’s are independent inde- 

m m+ 1 
, @) of Q, and let 
a= a~ (ay + ax?) and B=a+ So Ko > Fl/-a]. 


Our first theorem collects the information sania to canine isomorphism 


terminates. Take a diagonal representation (ap,.. 


of function fields of Pfister forms and their pure parts. 


Theorem 2. Suppose Q' is an anisotropic quadratic form over K. Assume 
further (with O, a, B, as given above): 

(a) Q' becomes hyperbolic in Ko: 
Then, 

(b) is an F-form Qo, such that Or ~(1,a)® Qo; 

(c) Oy 

(d) Q is similar to a subform of Q'. (Hence dim Q' > dim 92.) 


Proof. We show (a) =» (b) => (c) =» (d). Recall that the Witt index is 
preserved under purely transcendental field extensions. Thus, Or is aniso- 
tropic. To obtain (b) from (a), apply Lemma 1 over F with d=-a. Since 
(1, a), ~~ B, we have (1, a),,& B(1, a),,. (c) now follows at once. In 
taking any c € K* by 0’, O ~ cB. Applying the 
Cassels-Pfister subform theorem [6] (inhomogeneous form, but the same proof 
holds), it follows that (ca~'ap, wae ls , c) is a subform of Q’. But 
this subform is just ca™ 10, proving (d). Q.E.D. 

Remark. (c) =» (a) holds as well. ((c) =» (b) can be deduced by the 
Cassels-Pfister subform theorem.) Indeed, the equivalence of (a) and (c) is 
a special case of a beautiful theorem of Knebusch [1]. 


Theorem 3. If Q is an anisotropic Pfister form (dim Q' > 4) and 
Ko= Kon then O and OQ" are similar. 


Proof. Being a Pfister form Q’ becomes not merely isotropic, but 
actually hyperbolic in Since Ko = Kow Theorem 2 implies Q is 
similar to a subform of Q’. But dim Q= dim Q’ because Ko and Ko: have 
the same transcendence degree over K. So the subform must be all of Q’, 
completing the proof. 
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Theorem 4. If Q' is the pure part of an anisotropic Pfister form 
(dim QO’ > 3) and Ko = Kou, then Q and OQ" are similar. 


Proof. Say P&(1)10', a Pfister form. Over Ko» Q' becomes iso- 
tropic, so P becomes hyperbolic. By Theorem 2, Q is similar to a subform 
of P. But, by the transcendence degree argument just used, dim Q = dim OQ’. 
Thus, P cQ1(d) for some c, dé K*. Since Px d, P &dP&cdQ 1 (1). 
By the Witt cancellation theorem, 0’ = cdQ. Q.E.D. 

Note that the same kind of proof shows that if Q’ is a Pfiscer neighbor 
of the anisotropic Pfister form P and Ko = Kon then Q is also a Pfister 
neighbor of P and dim Q = dim Q’. (But see the comments at the end of $2.) 

Since there is only one similarity class of isotropic 3-dimensional forms, 
the condition that Q’ be anisotropic can be deleted when dim Q’ = 3. Thus, 
we have reproved Witt’s result which was the starting point of this investiga 
tion. 

One might hope to generalize Theorems 3 and 4 to anisotropic forms 
which become hyperbolic or nearly hyperbolic over their function fields. 

The next two theorems show that there is no further generalization.(3) 


Theorem 5. If Q becomes hyperbolic over its function field (dim Q > 4), 
then Q is already hyperbolic over K, or Q is similar to an anisotropic 
Pfister form. 


Proof. If Q is isotropic, then Kp is purely transcendental over K. So Q 
hyperbolic over Ko forces Q hyperbolic over K. 

Now assume Q is anisotropic. Applying a suitable similarity factor, we 
may assume Q~ 1. In the notation established above (with a= 1), we take 
Q' = O, and Theorem 2 implies Oy = BQy- That is, Q is strongly multi- 
plicative in the sense of Pfister [6] (inhomogeneous form). Being anisotropic, 
O must be a Pfister form. Q.E.D. 


Theorem 6. If Q becomes nearly hyperbolic over its function field 
(dim Q > 3), then Q is already nearly hyperbolic over K, or Q is similar 
to the pure part of an anisotropic Pfister form. 


Proof. The isotropic case is handled just as in the preceding proof. So 
assume Q is anisotropic. We simplify the notation by applying a similarity 
to obtain Q~ 1 (which permits us to take a= 1 inthe expressions for a and 
B). Let d = disc Q. 

Now, Q,, is anisotropic, but Q becomes nearly hyperbolic over 
Fly-a] = Ko. By Lemma 1, = (1, for some F-form Qp. 


(3) Theorems 5 and 6 have been obtained independently by Knebusch. 
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(5) can be determined by a comparison of discriminants. There are two 
possibilities, the first of which will be ruled out. 

Case 1, dim Q=1 (mod 4). Then dim Q) is even, so that 
disc ((1, a) ® = Hence, wecan take 5 = d, which shows that 0,,~ d. 
However, as F is purely transcendental over K, Cassel’s theorem [3, p. 18] 
implies Q~ d. This gives a decomposition of Q over K: O& 0,1 (d). 
Cancelling (d),, from the two decompositions of Q,, yields 0,,, =(1, a)® 
Q,. By Theorem 2 ((b) = (d)), Q must be similar to a subform of Q,, which 
is absurd, as dim Q, = dim Q — 1. Thus, Case 1 can never occur. 

Case 2. dim Q = 3 (mod 4). This time dim Q) is odd, so that 
disc ((1, a) ® = G, and (5) = (ad). Let P be the K-form Q 1(d), i.e., 
P =(a),...,@,,1, d). To complete the proof it suffices to show that P 
is an anisotropic Pfister form. (Then P = dP &(1) 1 dQ. So dQ is the pure 
part of P.) 

The decomposition of 0, yields P,, &(1, a) @(Q, 1(d)). So, by 
Theorem 2 ((b) =» (c)), Py = Hence, =AP,, where P' is the 
anisotropic part of P. By Theorem 2 ((c) =» (d)), Q is similar to a subform 
of Since dim Q = dim P —1, P must be anisotropic. 

Now take new independent indeterminates yo,.--, y,, and set K' = 
Kyo, and M’ = Myo, Y,) = K(x), Of course, 
Take any such that P,, ~c. Then Py, ~ cB, so 
that, by the Cassels-Pfister subform theorem (treating cB as a polynomial 
in the x,’s over K’), (cap, Ca,, cas c) is a subform of Pia A 


comparison of discriminants shows that P,, & (cap, Cy cd) = cP 


In particular, we may take c= + + + dy’, 
showing that P is strongly multiplicative, hence a Pfister form. Q.E.D. 


2. 4-dimensional forms. We now proceed to give an affirmative answer 
to question (f) for 4-dimensional forms. This is done by using the Pfister form 
results over a quadratic extension L of K, then working back to K. The 
key step is the transition from L to K, which is provided by the following 
theorem. 


Theorem 7. Let O and Q‘ be two 4-dimensional K-forms, each represent 
ing 1 and each with discriminant d. Let L= Kid]. Then Q and Q" are 
similar iff Q, =Q)- 

Proof. Necessity. Q, and Ot are Pfister forms, and hence isometric 
whenever they are similar. 

Sufficiency. Suppose QO, = Oi. Assume d ¢(K*)?—otherwise L = K 
and there is nothing to prove. If Q is isotropic, then so are Q, and Or. 


SIMILARITY OF QUADRATIC FORMS 357 


hence so is Q’ (a well-known fact which can be deduced from Lemma 1 bya 
discriminant argument). But then disc Q = disc Q’ implies that Q and Q’ 
are similar. Thus, we may assume Q and Q”" are anisotropic. 

Take decompositions Q &(1)1R and QO’ and ler S=R1 
(—R'). Since must be hyperbolic. If S were anisotropic, 
Lemma 1 would force disc §=-d. But disc S = disc R+ (-disc R’) = 
-14-d. Therefore, 5 must be isotropic. Since R and R’ are anisotropic it 
follows that there is an a€ K*, such that R~a and R' na. Hence, there 
exist diagonal representations Q a, b,bad) and Q'=(1,a, b’, b'ad), 
for some b, b’€ K*. 

We will demonstrate the similarity of Q and Q’ ‘‘piecewise”’, by 
finding a t€ K* with (1, 2)&¢(1, a) and (b', b'ad) = Ab, bad). To this 
end, consider the form T = (1, a, —bb', —bb'ad), whose discriminant is d. Working 
over L, where d is a square, we have 


bT, =(b, ba, -—b', —b'ad) =(b, bad, -b', -bad),. 


Thus, bT, is a subform of the hyperbolic form Q, ke Ol» with complement 
(1, a, -1, -a), which is also hyperbolic. Therefore, T, is hyperbolic. 
Using again the well-known fact quoted above, T itself is isotropic. From a 
nontrivial representation of 0 by 7, we obtain 2€K*, such that (1, a) ~t 
and (bb', bb'ad)~t. The two piecewise similarities now follow at once. 
Thus, O'~ 10. Q.E.D. 

This theorem may be of some interest in itsownright. One immediate 
consequence is that a Hasse principle for similarity of 4-dimensional forms 
over a global field may be deduced from the Hasse principle for isometry.(4) 
(The global square theorem [4, 65:15] shows that equality of discriminants 
can be verified locally.) 

For the proof of our final theorem, it is convenient to recast Theorem 7 
as follows: If Q and Q' are 4-dimensional forms each with discriminant d 
and L= KlYal, then Q and Q' are similar iff Q, and '. are similar. 


Theorem 8. Let Q and Q' be anisotropic 4-dimensional forms with 
Ko = Kor Then Q and O' are similar. 


Proof. Let = disc Q and = disc Q’. If d =1, then Q is similar 
to an anisotropic Pfister form (with the same function field), and Theorem 3 
applies. Therefore, we may assume that d, d‘ ¢ (K*)?, 

Let L = Kd]. Note that because Ko is a regular extension of K, the 


K-isomorphism of Ky and Ko, induces an L-isomorphism of Lo. of Lov: 


(4) Ono [5] has shown that the Hasse principle for similarity holds for forms of 
any dimension over a global field. 
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By Theorem 3 (Q, being similar to a Pfister form), Q, and Or are similar. 
In particular, disc Q, = disc ice., d'€ (L*)?, Since K* (K*)?, 

an easy computation (or an application of Lemma 1 to (1, -d')) shows that 
d'=d. Thus, we may apply Theorem 7 (as recast) to conclude that Q and 
Q’ are similar. Q.E.D. 

The techniques used for Pfister forms and 4-dimensional forms do not 
generalize readily to other kinds of forms. To illustrate the problems that can 
be encountered, it suffices to consider the example of Pfister neighbors. Let 
Q and Q° be two dissimilar forms of the same dimension, which are each a 
Pfister neighbor of the same anisotropic Pfister form P. (So dim P = 2’, for 
r> 3, and 2’~'<dim Q<2’— 1.) Then in any extension field F of K, Q, is 
isotropic iff P,, is hyperbolic iff Q), is isotropic. In particular, Q is 
isotropic over Kor » and vice versa. (In fact, it can be shown that for any 
K-form R, R is isotropic (resp. hyperbolic) over Ko iff R is isotropic 
(resp. hyperbolic) over Ko: -) Further, for every algebraic extension L of K, 


Lo . is purely transcendental over L iff Lo. is purely transcendental over 


L. Whether Kp and Ko: can be isomorphic is unclear. It appears that new 
techniques will be necessary to settle this question. 

Added in proof. M. Knebusch has shown that dissimilar Pfister neigh- 
bors often have isomorphic function fields. Specifically, if Q and Q’ are 
neighbors of the Pfister form P, with dim P = 2’, and if Q and Q' each 
have subforms similar to the Pfister form R, with dim R = 2"~!, and dim Q = 
dim 0", then Ko = Kor This is one of many interesting results in his 
excellent paper Generic splitting of quadratic forms. I, to appear in Proc. 
London Math. Soc. 
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